Aug 09 00:47:03 user nova-compute[72780]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 00:47:05 user nova-compute[72780]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72780) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 00:47:05 user nova-compute[72780]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72780) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 00:47:05 user nova-compute[72780]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72780) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 00:47:05 user nova-compute[72780]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:47:06 user nova-compute[72780]: INFO nova.virt.driver [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 00:47:06 user nova-compute[72780]: INFO nova.compute.provider_config [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Acquiring lock "singleton_lock" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Acquired lock "singleton_lock" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Releasing lock "singleton_lock" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Full set of CONF: {{(pid=72780) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ******************************************************************************** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Configuration options gathered from: {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ================================================================================ {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] allow_resize_to_same_host      = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] arq_binding_timeout            = 300 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] backdoor_port                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] backdoor_socket                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] block_device_allocate_retries  = 300 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] block_device_allocate_retries_interval = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cert                           = self.pem {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute_monitors               = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] config_dir                     = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] config_drive_format            = iso9660 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] config_source                  = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] console_host                   = user {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] control_exchange               = nova {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cpu_allocation_ratio           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] daemon                         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] debug                          = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] default_access_ip_network_name = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] default_availability_zone      = nova {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] default_ephemeral_format       = ext4 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] default_schedule_zone          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] disk_allocation_ratio          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] enable_new_services            = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] enabled_ssl_apis               = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] flat_injected                  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] force_config_drive             = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] force_raw_images               = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] graceful_shutdown_timeout      = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] heal_instance_info_cache_interval = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] host                           = user {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_build_timeout         = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_delete_interval       = 300 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_name_template         = instance-%08x {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_usage_audit           = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_usage_audit_period    = month {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] internal_service_availability_zone = internal {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] key                            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] live_migration_retry_count     = 30 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_config_append              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_dir                        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_file                       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_options                    = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_rotate_interval            = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_rotate_interval_type       = days {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] log_rotation_type              = none {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] long_rpc_timeout               = 1800 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] max_concurrent_builds          = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] max_concurrent_live_migrations = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] max_concurrent_snapshots       = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] max_local_block_devices        = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] max_logfile_count              = 30 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] max_logfile_size_mb            = 200 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] maximum_instance_delete_attempts = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metadata_listen                = 0.0.0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metadata_listen_port           = 8775 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metadata_workers               = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] migrate_max_retries            = -1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] mkisofs_cmd                    = genisoimage {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] my_ip                          = 10.0.0.210 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] network_allocate_retries       = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] osapi_compute_listen_port      = 8774 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] osapi_compute_unique_server_name_scope =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] osapi_compute_workers          = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] password_length                = 12 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] periodic_enable                = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] periodic_fuzzy_delay           = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] pointer_model                  = ps2mouse {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] preallocate_images             = none {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] publish_errors                 = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] pybasedir                      = /opt/stack/nova {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ram_allocation_ratio           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rate_limit_burst               = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rate_limit_except_level        = CRITICAL {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rate_limit_interval            = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reboot_timeout                 = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reclaim_instance_interval      = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] record                         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reimage_timeout_per_gb         = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] report_interval                = 120 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rescue_timeout                 = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reserved_host_cpus             = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reserved_host_disk_mb          = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reserved_host_memory_mb        = 512 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] reserved_huge_pages            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] resize_confirm_window          = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] resize_fs_using_block_device   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] resume_guests_state_on_host_boot = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rpc_response_timeout           = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] run_external_periodic_tasks    = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] running_deleted_instance_action = reap {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] running_deleted_instance_timeout = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler_instance_sync_interval = 120 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_down_time              = 720 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] servicegroup_driver            = db {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] shelved_offload_time           = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] shelved_poll_interval          = 3600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] shutdown_timeout               = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] source_is_ipv6                 = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ssl_only                       = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] state_path                     = /opt/stack/data/nova {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] sync_power_state_interval      = 600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] sync_power_state_pool_size     = 1000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] syslog_log_facility            = LOG_USER {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] tempdir                        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] timeout_nbd                    = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] transport_url                  = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] update_resources_interval      = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_cow_images                 = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_eventlog                   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_journal                    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_json                       = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_rootwrap_daemon            = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_stderr                     = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] use_syslog                     = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vcpu_pin_set                   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plugging_is_fatal          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plugging_timeout           = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] virt_mkfs                      = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] volume_usage_poll_interval     = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] watch_log_file                 = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] web                            = /usr/share/spice-html5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_concurrency.disable_process_locking = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.auth_strategy              = keystone {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.compute_link_prefix        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.dhcp_domain                = novalocal {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.enable_instance_password   = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.glance_link_prefix         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.instance_list_per_project_cells = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.list_records_by_skipping_down_cells = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.local_metadata_per_cell    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.max_limit                  = 1000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.metadata_cache_expiration  = 15 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.neutron_default_tenant_id  = default {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.use_forwarded_for          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.use_neutron_default_nets   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_dynamic_targets = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_jsonfile_path   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.backend_argument         = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.config_prefix            = cache.oslo {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.dead_timeout             = 60.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.debug_cache_backend      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.enable_retry_client      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.enable_socket_keepalive  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.enabled                  = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.expiration_time          = 600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.hashclient_retry_attempts = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_dead_retry      = 300 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_password        =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_sasl_enabled    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.memcache_username        =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.proxies                  = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.retry_attempts           = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.retry_delay              = 0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.socket_keepalive_count   = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.socket_keepalive_idle    = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.socket_keepalive_interval = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.tls_allowed_ciphers      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.tls_cafile               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.tls_certfile             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.tls_enabled              = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cache.tls_keyfile              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.auth_section            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.auth_type               = password {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.cafile                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.certfile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.collect_timing          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.cross_az_attach         = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.debug                   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.endpoint_template       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.http_retries            = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.insecure                = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.keyfile                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.os_region_name          = RegionOne {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.split_loggers           = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cinder.timeout                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.cpu_dedicated_set      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.cpu_shared_set         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.image_type_exclude_list = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.resource_provider_association_refresh = 300 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.shutdown_retry_interval = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] conductor.workers              = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] console.allowed_origins        = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] console.ssl_ciphers            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] console.ssl_minimum_version    = default {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] consoleauth.token_ttl          = 600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.cafile                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.certfile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.collect_timing          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.connect_retries         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.connect_retry_delay     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.endpoint_override       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.insecure                = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.keyfile                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.max_version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.min_version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.region_name             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.service_name            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.service_type            = accelerator {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.split_loggers           = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.status_code_retries     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.timeout                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] cyborg.version                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.backend               = sqlalchemy {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.connection            = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.connection_debug      = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.connection_parameters =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.connection_recycle_time = 3600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.connection_trace      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.db_inc_retry_interval = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.db_max_retries        = 20 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.db_max_retry_interval = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.db_retry_interval     = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.max_overflow          = 50 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.max_pool_size         = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.max_retries           = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.mysql_enable_ndb      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.mysql_wsrep_sync_wait = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.pool_timeout          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.retry_interval        = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.slave_connection      = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] database.sqlite_synchronous    = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.backend           = sqlalchemy {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.connection        = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.connection_debug  = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.connection_parameters =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.connection_recycle_time = 3600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.connection_trace  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.db_inc_retry_interval = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.db_max_retries    = 20 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.db_max_retry_interval = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.db_retry_interval = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.max_overflow      = 50 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.max_pool_size     = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.max_retries       = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.mysql_enable_ndb  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.pool_timeout      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.retry_interval    = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.slave_connection  = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] api_database.sqlite_synchronous = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] devices.enabled_mdev_types     = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ephemeral_storage_encryption.enabled = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.api_servers             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.cafile                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.certfile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.collect_timing          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.connect_retries         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.connect_retry_delay     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.debug                   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.default_trusted_certificate_ids = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.enable_certificate_validation = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.enable_rbd_download     = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.endpoint_override       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.insecure                = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.keyfile                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.max_version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.min_version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.num_retries             = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.rbd_ceph_conf           =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.rbd_connect_timeout     = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.rbd_pool                =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.rbd_user                =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.region_name             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.service_name            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.service_type            = image {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.split_loggers           = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.status_code_retries     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.timeout                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.verify_glance_signatures = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] glance.version                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] guestfs.debug                  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.config_drive_cdrom      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.config_drive_inject_password = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.enable_remotefx         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.instances_path_share    =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.limit_cpu_features      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.use_multipath_io        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.vswitch_name            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] mks.enabled                    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] image_cache.manager_interval   = 2400 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] image_cache.precache_concurrency = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] image_cache.remove_unused_base_images = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] image_cache.subdirectory_name  = _base {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.api_max_retries         = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.api_retry_interval      = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.auth_section            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.auth_type               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.cafile                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.certfile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.collect_timing          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.connect_retries         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.connect_retry_delay     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.endpoint_override       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.insecure                = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.keyfile                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.max_version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.min_version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.partition_key           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.peer_list               = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.region_name             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.serial_console_state_timeout = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.service_name            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.service_type            = baremetal {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.split_loggers           = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.status_code_retries     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.timeout                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ironic.version                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] key_manager.fixed_key          = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.barbican_api_version  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.barbican_endpoint     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.barbican_endpoint_type = public {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.barbican_region_name  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.cafile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.certfile              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.collect_timing        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.insecure              = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.keyfile               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.number_of_retries     = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.retry_delay           = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.send_service_user_token = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.split_loggers         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.timeout               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.verify_ssl            = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican.verify_ssl_path       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.auth_section = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.auth_type = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.cafile   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.certfile = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.collect_timing = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.insecure = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.keyfile  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.split_loggers = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] barbican_service_user.timeout  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.approle_role_id          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.approle_secret_id        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.cafile                   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.certfile                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.collect_timing           = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.insecure                 = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.keyfile                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.kv_mountpoint            = secret {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.kv_version               = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.namespace                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.root_token_id            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.split_loggers            = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.ssl_ca_crt_file          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.timeout                  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.use_ssl                  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.cafile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.certfile              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.collect_timing        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.connect_retries       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.connect_retry_delay   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.endpoint_override     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.insecure              = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.keyfile               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.max_version           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.min_version           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.region_name           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.service_name          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.service_type          = identity {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.split_loggers         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.status_code_retries   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.timeout               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] keystone.version               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.connection_uri         =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_mode               = custom {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: WARNING oslo_config.cfg [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_power_governor_high = performance {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_power_management   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.device_detach_attempts = 8 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.device_detach_timeout  = 20 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.disk_cachemodes        = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.disk_prefix            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.enabled_perf_events    = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.file_backed_memory     = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.gid_maps               = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.hw_disk_discard        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.hw_machine_type        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_rbd_pool        = rbd {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_type            = default {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.images_volume_group    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.inject_key             = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.inject_partition       = -2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.inject_password        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.iscsi_iface            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.iser_use_multipath     = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_downtime = 500 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_inbound_addr = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_scheme  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_timeout_action = abort {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_tunnelled = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: WARNING oslo_config.cfg [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 00:47:06 user nova-compute[72780]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 00:47:06 user nova-compute[72780]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 00:47:06 user nova-compute[72780]: and ``live_migration_inbound_addr`` respectively.
Aug 09 00:47:06 user nova-compute[72780]: ).  Its value may be silently ignored in the future.
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.live_migration_with_native_tls = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.max_queues             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.nfs_mount_options      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.num_pcie_ports         = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.pmem_namespaces        = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.quobyte_client_cfg     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rbd_secret_uuid        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rbd_user               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rescue_image_id        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rescue_kernel_id       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.rx_queue_size          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.smbfs_mount_options    =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.snapshot_compression   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.snapshot_image_format  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.sparse_logical_volumes = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.swtpm_enabled          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.swtpm_group            = tss {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.swtpm_user             = tss {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.sysinfo_serial         = unique {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.tb_cache_size          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.tx_queue_size          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.uid_maps               = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.use_virtio_for_bridges = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.virt_type              = kvm {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.volume_clear           = zero {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.volume_clear_size      = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.volume_use_multipath   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_cache_path   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.auth_section           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.auth_type              = password {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.cafile                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.certfile               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.collect_timing         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.connect_retries        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.connect_retry_delay    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.default_floating_pool  = public {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.endpoint_override      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.extension_sync_interval = 600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.http_retries           = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.insecure               = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.keyfile                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.max_version            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.min_version            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.ovs_bridge             = br-int {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.physnets               = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.region_name            = RegionOne {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.service_metadata_proxy = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.service_name           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.service_type           = network {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.split_loggers          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.status_code_retries    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.timeout                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] neutron.version                = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] notifications.bdms_in_notifications = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] notifications.default_level    = INFO {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] notifications.notification_format = unversioned {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] notifications.notify_on_state_change = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] pci.alias                      = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] pci.device_spec                = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] pci.report_in_placement        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.auth_section         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.auth_type            = password {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.cafile               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.certfile             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.collect_timing       = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.connect_retries      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.connect_retry_delay  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.default_domain_id    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.default_domain_name  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.domain_id            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.domain_name          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.endpoint_override    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.insecure             = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.keyfile              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.max_version          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.min_version          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.password             = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.project_domain_id    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.project_domain_name  = Default {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.project_id           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.project_name         = service {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.region_name          = RegionOne {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.service_name         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.service_type         = placement {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.split_loggers        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.status_code_retries  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.system_scope         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.timeout              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.trust_id             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.user_domain_id       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.user_domain_name     = Default {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.user_id              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.username             = placement {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] placement.version              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.cores                    = 20 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.count_usage_from_placement = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.injected_file_content_bytes = 10240 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.injected_file_path_length = 255 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.injected_files           = 5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.instances                = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.key_pairs                = 100 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.metadata_items           = 128 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.ram                      = 51200 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.recheck_quota            = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.server_group_members     = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] quota.server_groups            = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rdp.enabled                    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.image_metadata_prefilter = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.max_attempts         = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.max_placement_results = 1000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] scheduler.workers              = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.host_subset_size = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.isolated_hosts = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.isolated_images = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.pci_in_placement = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.track_instance_changes = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metrics.required               = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metrics.weight_multiplier      = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] metrics.weight_setting         = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] serial_console.enabled         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] serial_console.port_range      = 10000:20000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] serial_console.serialproxy_port = 6083 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.auth_section      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.auth_type         = password {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.cafile            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.certfile          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.collect_timing    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.insecure          = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.keyfile           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.send_service_user_token = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.split_loggers     = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] service_user.timeout           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.agent_enabled            = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.enabled                  = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.html5proxy_port          = 6082 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.image_compression        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.jpeg_compression         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.playback_compression     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.server_listen            = 127.0.0.1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.streaming_mode           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] spice.zlib_compression         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] upgrade_levels.baseapi         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] upgrade_levels.cert            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] upgrade_levels.compute         = auto {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] upgrade_levels.conductor       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] upgrade_levels.scheduler       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.cafile = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.certfile = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.insecure = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vendordata_dynamic_auth.timeout = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.api_retry_count         = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.ca_file                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.cache_prefix            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.cluster_name            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.connection_pool_size    = 10 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.console_delay_seconds   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.datastore_regex         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.host_ip                 = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.host_password           = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.host_port               = 443 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.host_username           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.insecure                = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.integration_bridge      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.maximum_objects         = 100 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.pbm_default_policy      = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.pbm_enabled             = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.pbm_wsdl_location       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.serial_port_proxy_uri   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.serial_port_service_uri = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.task_poll_interval      = 0.5 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.use_linked_clone        = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.vnc_keymap              = en-us {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.vnc_port                = 5900 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vmware.vnc_port_total          = 10000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.auth_schemes               = ['none'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.enabled                    = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.novncproxy_port            = 6080 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.vencrypt_ca_certs          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.vencrypt_client_cert       = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vnc.vencrypt_client_key        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.disable_rootwrap   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.enable_numa_live_migration = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.libvirt_disable_apic = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.client_socket_timeout     = 900 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.default_pool_size         = 1000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.keep_alive                = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.max_header_line           = 16384 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.ssl_ca_file               = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.ssl_cert_file             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.ssl_key_file              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.tcp_keepidle              = 600 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] zvm.ca_file                    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] zvm.cloud_connector_url        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] zvm.reachable_timeout          = 300 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.enforce_new_defaults = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.enforce_scope      = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.policy_default_rule = default {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.connection_string     = messaging:// {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.enabled               = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.es_doc_type           = notification {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.es_scroll_size        = 10000 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.es_scroll_time        = 2m {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.filter_error_trace    = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.hmac_keys             = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.sentinel_service_name = mymaster {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.socket_timeout        = 0.1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.trace_requests        = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler.trace_sqlalchemy      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler_jaeger.process_tags   = {} {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler_jaeger.service_name_prefix = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] profiler_otlp.service_name_prefix = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] remote_debug.host              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] remote_debug.port              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_notifications.retry = -1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.auth_section        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.auth_type           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.cafile              = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.certfile            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.collect_timing      = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.connect_retries     = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.connect_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.endpoint_id         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.endpoint_override   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.insecure            = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.keyfile             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.max_version         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.min_version         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.region_name         = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.service_name        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.service_type        = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.split_loggers       = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.status_code_retries = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.status_code_retry_delay = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.timeout             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.valid_interfaces    = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_limit.version             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_reports.file_event_handler = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] oslo_reports.log_dir           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_ovs_privileged.group  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] vif_plug_ovs_privileged.user   = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_ovs.isolate_vif         = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] os_brick.lock_path             = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] privsep_osbrick.capabilities   = [21] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] privsep_osbrick.group          = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] privsep_osbrick.helper_command = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] privsep_osbrick.user           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] nova_sys_admin.group           = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] nova_sys_admin.helper_command  = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] nova_sys_admin.user            = None {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG oslo_service.service [None req-61c083a6-509f-4803-990f-08149cae18a8 None None] ******************************************************************************** {{(pid=72780) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 00:47:06 user nova-compute[72780]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Starting native event thread {{(pid=72780) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Starting green dispatch thread {{(pid=72780) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Starting connection event dispatch thread {{(pid=72780) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Connecting to libvirt: qemu:///system {{(pid=72780) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0ae24f0af0> {{(pid=72780) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0ae24f0af0> {{(pid=72780) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 00:47:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Connection event '1' reason 'None'
Aug 09 00:47:06 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 00:47:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.mount [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Initialising _HostMountState generation 0 {{(pid=72780) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 00:47:13 user nova-compute[72780]: INFO nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host capabilities <capabilities>
Aug 09 00:47:13 user nova-compute[72780]:   <host>
Aug 09 00:47:13 user nova-compute[72780]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 00:47:13 user nova-compute[72780]:     <cpu>
Aug 09 00:47:13 user nova-compute[72780]:       <arch>x86_64</arch>
Aug 09 00:47:13 user nova-compute[72780]:       <model>IvyBridge-IBRS</model>
Aug 09 00:47:13 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:13 user nova-compute[72780]:       <microcode version='1070'/>
Aug 09 00:47:13 user nova-compute[72780]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 00:47:13 user nova-compute[72780]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='ss'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='vmx'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='pcid'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='osxsave'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='hypervisor'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='arat'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='tsc_adjust'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='md-clear'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='stibp'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='arch-capabilities'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='ssbd'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='invtsc'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='rsba'/>
Aug 09 00:47:13 user nova-compute[72780]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 00:47:13 user nova-compute[72780]:       <pages unit='KiB' size='4'/>
Aug 09 00:47:13 user nova-compute[72780]:       <pages unit='KiB' size='2048'/>
Aug 09 00:47:13 user nova-compute[72780]:     </cpu>
Aug 09 00:47:13 user nova-compute[72780]:     <power_management>
Aug 09 00:47:13 user nova-compute[72780]:       <suspend_mem/>
Aug 09 00:47:13 user nova-compute[72780]:       <suspend_disk/>
Aug 09 00:47:13 user nova-compute[72780]:       <suspend_hybrid/>
Aug 09 00:47:13 user nova-compute[72780]:     </power_management>
Aug 09 00:47:13 user nova-compute[72780]:     <iommu support='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     <migration_features>
Aug 09 00:47:13 user nova-compute[72780]:       <live/>
Aug 09 00:47:13 user nova-compute[72780]:       <uri_transports>
Aug 09 00:47:13 user nova-compute[72780]:         <uri_transport>tcp</uri_transport>
Aug 09 00:47:13 user nova-compute[72780]:         <uri_transport>rdma</uri_transport>
Aug 09 00:47:13 user nova-compute[72780]:       </uri_transports>
Aug 09 00:47:13 user nova-compute[72780]:     </migration_features>
Aug 09 00:47:13 user nova-compute[72780]:     <topology>
Aug 09 00:47:13 user nova-compute[72780]:       <cells num='2'>
Aug 09 00:47:13 user nova-compute[72780]:         <cell id='0'>
Aug 09 00:47:13 user nova-compute[72780]:           <memory unit='KiB'>8189224</memory>
Aug 09 00:47:13 user nova-compute[72780]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 09 00:47:13 user nova-compute[72780]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 00:47:13 user nova-compute[72780]:           <distances>
Aug 09 00:47:13 user nova-compute[72780]:             <sibling id='0' value='10'/>
Aug 09 00:47:13 user nova-compute[72780]:             <sibling id='1' value='20'/>
Aug 09 00:47:13 user nova-compute[72780]:           </distances>
Aug 09 00:47:13 user nova-compute[72780]:           <cpus num='6'>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 00:47:13 user nova-compute[72780]:           </cpus>
Aug 09 00:47:13 user nova-compute[72780]:         </cell>
Aug 09 00:47:13 user nova-compute[72780]:         <cell id='1'>
Aug 09 00:47:13 user nova-compute[72780]:           <memory unit='KiB'>8206460</memory>
Aug 09 00:47:13 user nova-compute[72780]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 09 00:47:13 user nova-compute[72780]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 00:47:13 user nova-compute[72780]:           <distances>
Aug 09 00:47:13 user nova-compute[72780]:             <sibling id='0' value='20'/>
Aug 09 00:47:13 user nova-compute[72780]:             <sibling id='1' value='10'/>
Aug 09 00:47:13 user nova-compute[72780]:           </distances>
Aug 09 00:47:13 user nova-compute[72780]:           <cpus num='6'>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 00:47:13 user nova-compute[72780]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 00:47:13 user nova-compute[72780]:           </cpus>
Aug 09 00:47:13 user nova-compute[72780]:         </cell>
Aug 09 00:47:13 user nova-compute[72780]:       </cells>
Aug 09 00:47:13 user nova-compute[72780]:     </topology>
Aug 09 00:47:13 user nova-compute[72780]:     <cache>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 00:47:13 user nova-compute[72780]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 00:47:13 user nova-compute[72780]:     </cache>
Aug 09 00:47:13 user nova-compute[72780]:     <secmodel>
Aug 09 00:47:13 user nova-compute[72780]:       <model>apparmor</model>
Aug 09 00:47:13 user nova-compute[72780]:       <doi>0</doi>
Aug 09 00:47:13 user nova-compute[72780]:     </secmodel>
Aug 09 00:47:13 user nova-compute[72780]:     <secmodel>
Aug 09 00:47:13 user nova-compute[72780]:       <model>dac</model>
Aug 09 00:47:13 user nova-compute[72780]:       <doi>0</doi>
Aug 09 00:47:13 user nova-compute[72780]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 00:47:13 user nova-compute[72780]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 00:47:13 user nova-compute[72780]:     </secmodel>
Aug 09 00:47:13 user nova-compute[72780]:   </host>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='alpha'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>clipper</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:13 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:13 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     </features>
Aug 09 00:47:13 user nova-compute[72780]:   </guest>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='armv6l'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>spitz</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>nuri</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>kzm</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sx1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>z2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>tosa</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>n810</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>n800</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>terrier</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>midway</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>microbit</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>verdex</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>highbank</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>akita</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>connex</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>collie</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:13 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:13 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     </features>
Aug 09 00:47:13 user nova-compute[72780]:   </guest>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='armv7l'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>spitz</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>nuri</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>kzm</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sx1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>z2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>tosa</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>n810</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>n800</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>terrier</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>midway</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>microbit</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>verdex</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>highbank</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>akita</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>connex</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>collie</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:13 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:13 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     </features>
Aug 09 00:47:13 user nova-compute[72780]:   </guest>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='aarch64'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>spitz</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>nuri</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>kzm</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sx1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>z2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>tosa</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>n810</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>n800</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>terrier</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>midway</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>microbit</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>verdex</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='4'>highbank</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>akita</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>connex</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>collie</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <acpi default='on' toggle='yes'/>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:13 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:13 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     </features>
Aug 09 00:47:13 user nova-compute[72780]:   </guest>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='cris'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:13 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:13 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     </features>
Aug 09 00:47:13 user nova-compute[72780]:   </guest>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='i686'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>isapc</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>microvm</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='kvm'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <pae/>
Aug 09 00:47:13 user nova-compute[72780]:       <nonpae/>
Aug 09 00:47:13 user nova-compute[72780]:       <acpi default='on' toggle='yes'/>
Aug 09 00:47:13 user nova-compute[72780]:       <apic default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:13 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:13 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:13 user nova-compute[72780]:     </features>
Aug 09 00:47:13 user nova-compute[72780]:   </guest>
Aug 09 00:47:13 user nova-compute[72780]:   <guest>
Aug 09 00:47:13 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:13 user nova-compute[72780]:     <arch name='m68k'>
Aug 09 00:47:13 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:13 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>an5206</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>q800</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 00:47:13 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:13 user nova-compute[72780]:     </arch>
Aug 09 00:47:13 user nova-compute[72780]:     <features>
Aug 09 00:47:13 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='microblaze'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='microblazeel'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='mips'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='16'>malta</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='mipsel'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='16'>malta</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='mips64'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='16'>malta</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>pica61</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>magnum</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='mips64el'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='16'>malta</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>pica61</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>magnum</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='16'>boston</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='ppc'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mac99</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>40p</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>taihu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='ppc64'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>taihu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>40p</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mac99</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='ppc64le'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>taihu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>40p</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>mac99</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='riscv32'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='8'>spike</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='8'>virt</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='riscv64'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='8'>spike</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='8'>virt</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='s390x'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='sh4'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>shix</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>r2d</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='sh4eb'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>shix</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>r2d</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='sparc'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>LX</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='sparc64'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>niagara</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='x86_64'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>64</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='1'>isapc</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>microvm</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='kvm'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <acpi default='on' toggle='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:       <apic default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='xtensa'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='4'>sim</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>kc705</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ml605</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>virt</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx200</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx60</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]:   <guest>
Aug 09 00:47:14 user nova-compute[72780]:     <os_type>hvm</os_type>
Aug 09 00:47:14 user nova-compute[72780]:     <arch name='xtensaeb'>
Aug 09 00:47:14 user nova-compute[72780]:       <wordsize>32</wordsize>
Aug 09 00:47:14 user nova-compute[72780]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='4'>sim</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>kc705</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ml605</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>virt</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx200</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>lx60</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 00:47:14 user nova-compute[72780]:       <domain type='qemu'/>
Aug 09 00:47:14 user nova-compute[72780]:     </arch>
Aug 09 00:47:14 user nova-compute[72780]:     <features>
Aug 09 00:47:14 user nova-compute[72780]:       <cpuselection/>
Aug 09 00:47:14 user nova-compute[72780]:       <deviceboot/>
Aug 09 00:47:14 user nova-compute[72780]:       <disksnapshot default='on' toggle='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     </features>
Aug 09 00:47:14 user nova-compute[72780]:   </guest>
Aug 09 00:47:14 user nova-compute[72780]: </capabilities>
Aug 09 00:47:14 user nova-compute[72780]: 
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-q35-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>i686</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='288'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'/>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='lm'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-i440fx-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>i686</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='255'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'/>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='lm'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ide</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-i440fx-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>i686</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='255'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'/>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='lm'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ide</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-q35-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>i686</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='288'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'/>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='lm'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-q35-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>x86_64</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='288'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>efi</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='invtsc'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='rsba'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-i440fx-jammy</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>x86_64</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='255'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>efi</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='invtsc'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='rsba'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ide</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-i440fx-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>x86_64</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='255'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>efi</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='invtsc'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='rsba'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ide</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 00:47:14 user nova-compute[72780]: <domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 00:47:14 user nova-compute[72780]:   <domain>kvm</domain>
Aug 09 00:47:14 user nova-compute[72780]:   <machine>pc-q35-6.2</machine>
Aug 09 00:47:14 user nova-compute[72780]:   <arch>x86_64</arch>
Aug 09 00:47:14 user nova-compute[72780]:   <vcpu max='288'/>
Aug 09 00:47:14 user nova-compute[72780]:   <iothreads supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:   <os supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='firmware'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>efi</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:     <loader supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>rom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pflash</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='readonly'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='secure'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>yes</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>no</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </loader>
Aug 09 00:47:14 user nova-compute[72780]:   </os>
Aug 09 00:47:14 user nova-compute[72780]:   <cpu>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-passthrough' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='hostPassthroughMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='maximum' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='maximumMigratable'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>on</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>off</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='host-model' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <vendor>Intel</vendor>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ss'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='vmx'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pcid'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='hypervisor'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arat'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='umip'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='md-clear'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='invtsc'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibpb'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='ibrs'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-stibp'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='rsba'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='erms'/>
Aug 09 00:47:14 user nova-compute[72780]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:     <mode name='custom' supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>qemu64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>qemu32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>phenom</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>pentium</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>n270</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm64</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>kvm32</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>coreduo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>core2duo</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>athlon</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Westmere</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Snowridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Skylake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>SandyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Penryn</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G5</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G4</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G3</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Opteron_G2</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Opteron_G1</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>IvyBridge</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Icelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Haswell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Rome</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-Milan</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>EPYC</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Dhyana</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cooperlake</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>Conroe</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='no'>Broadwell</model>
Aug 09 00:47:14 user nova-compute[72780]:       <model usable='yes'>486</model>
Aug 09 00:47:14 user nova-compute[72780]:     </mode>
Aug 09 00:47:14 user nova-compute[72780]:   </cpu>
Aug 09 00:47:14 user nova-compute[72780]:   <memoryBacking supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:     <enum name='sourceType'>
Aug 09 00:47:14 user nova-compute[72780]:       <value>file</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>anonymous</value>
Aug 09 00:47:14 user nova-compute[72780]:       <value>memfd</value>
Aug 09 00:47:14 user nova-compute[72780]:     </enum>
Aug 09 00:47:14 user nova-compute[72780]:   </memoryBacking>
Aug 09 00:47:14 user nova-compute[72780]:   <devices>
Aug 09 00:47:14 user nova-compute[72780]:     <disk supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='diskDevice'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>disk</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cdrom</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>floppy</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>lun</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='bus'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>fdc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sata</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </disk>
Aug 09 00:47:14 user nova-compute[72780]:     <graphics supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='type'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>sdl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vnc</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>spice</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egl-headless</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </graphics>
Aug 09 00:47:14 user nova-compute[72780]:     <video supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='modelType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>cirrus</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>vmvga</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>qxl</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>none</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>bochs</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>ramfb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </video>
Aug 09 00:47:14 user nova-compute[72780]:     <hostdev supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='mode'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>subsystem</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='startupPolicy'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>default</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>mandatory</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>requisite</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>optional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='subsysType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>usb</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>pci</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>scsi</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='capsType'/>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='pciBackend'/>
Aug 09 00:47:14 user nova-compute[72780]:     </hostdev>
Aug 09 00:47:14 user nova-compute[72780]:     <rng supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtio-non-transitional</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>random</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>egd</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>builtin</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </rng>
Aug 09 00:47:14 user nova-compute[72780]:     <filesystem supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='driverType'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>path</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>handle</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>virtiofs</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </filesystem>
Aug 09 00:47:14 user nova-compute[72780]:     <tpm supported='yes'>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='model'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-tis</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>tpm-crb</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:       <enum name='backendModel'>
Aug 09 00:47:14 user nova-compute[72780]:         <value>passthrough</value>
Aug 09 00:47:14 user nova-compute[72780]:         <value>emulator</value>
Aug 09 00:47:14 user nova-compute[72780]:       </enum>
Aug 09 00:47:14 user nova-compute[72780]:     </tpm>
Aug 09 00:47:14 user nova-compute[72780]:   </devices>
Aug 09 00:47:14 user nova-compute[72780]:   <features>
Aug 09 00:47:14 user nova-compute[72780]:     <gic supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:     <vmcoreinfo supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <genid supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backingStoreInput supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <backup supported='yes'/>
Aug 09 00:47:14 user nova-compute[72780]:     <sev supported='no'/>
Aug 09 00:47:14 user nova-compute[72780]:   </features>
Aug 09 00:47:14 user nova-compute[72780]: </domainCapabilities>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72780) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72780) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Checking secure boot support for host arch (x86_64) {{(pid=72780) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 00:47:14 user nova-compute[72780]: INFO nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Secure Boot support detected
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] cpu compare xml: <cpu match="exact">
Aug 09 00:47:14 user nova-compute[72780]:   <model>Nehalem</model>
Aug 09 00:47:14 user nova-compute[72780]: </cpu>
Aug 09 00:47:14 user nova-compute[72780]:  {{(pid=72780) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 00:47:14 user nova-compute[72780]: INFO nova.virt.node [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Generated node identity b9abbddb-d385-4222-ae5f-4e6421336ccf
Aug 09 00:47:14 user nova-compute[72780]: INFO nova.virt.node [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Wrote node identity b9abbddb-d385-4222-ae5f-4e6421336ccf to /opt/stack/data/nova/compute_id
Aug 09 00:47:14 user nova-compute[72780]: WARNING nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Compute nodes ['b9abbddb-d385-4222-ae5f-4e6421336ccf'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 00:47:14 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 00:47:14 user nova-compute[72780]: WARNING nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 00:47:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:47:14 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:47:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:47:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Hypervisor/Node resource view: name=user free_ram=10953MB free_disk=26.164615631103516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:47:15 user nova-compute[72780]: WARNING nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] No compute node record for user:b9abbddb-d385-4222-ae5f-4e6421336ccf: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b9abbddb-d385-4222-ae5f-4e6421336ccf could not be found.
Aug 09 00:47:15 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Compute node record created for user:user with uuid: b9abbddb-d385-4222-ae5f-4e6421336ccf
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:47:15 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [req-a651156a-29af-46eb-beb7-f872d3fa472a] Created resource provider record via placement API for resource provider with UUID b9abbddb-d385-4222-ae5f-4e6421336ccf and name user.
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72780) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 00:47:15 user nova-compute[72780]: INFO nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] kernel doesn't support AMD SEV
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Libvirt baseline CPU <cpu>
Aug 09 00:47:15 user nova-compute[72780]:   <arch>x86_64</arch>
Aug 09 00:47:15 user nova-compute[72780]:   <model>Nehalem</model>
Aug 09 00:47:15 user nova-compute[72780]:   <vendor>Intel</vendor>
Aug 09 00:47:15 user nova-compute[72780]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 00:47:15 user nova-compute[72780]: </cpu>
Aug 09 00:47:15 user nova-compute[72780]:  {{(pid=72780) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Updated inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Updating resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf generation from 0 to 1 during operation: update_inventory {{(pid=72780) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Updating resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf generation from 1 to 2 during operation: update_traits {{(pid=72780) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.service [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Creating RPC server for service compute {{(pid=72780) start /opt/stack/nova/nova/service.py:182}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.service [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Join ServiceGroup membership for this service compute {{(pid=72780) start /opt/stack/nova/nova/service.py:199}}
Aug 09 00:47:15 user nova-compute[72780]: DEBUG nova.servicegroup.drivers.db [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72780) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 00:47:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:47:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:48:06 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:48:06 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=10218MB free_disk=26.068248748779297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:48:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:49:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:49:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:49:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=10204MB free_disk=26.113094329833984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:49:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:50:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:50:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:50:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=10210MB free_disk=25.887367248535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:50:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:50:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:50:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:50:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:50:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:50:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:51:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:51:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=9466MB free_disk=25.918624877929688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:51:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:51:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:51:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:51:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:51:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:17 user nova-compute[72780]: INFO nova.compute.claims [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Claim successful on node user
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.network.neutron [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Creating image(s)
Aug 09 00:51:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "/opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "/opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "/opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:18 user nova-compute[72780]: DEBUG nova.policy [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afa730eff7784a58b1fbe6e5d74a66cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808478f7b961489f90b4ff1b5ad8f8eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.part --force-share --output=json" returned: 0 in 0.198s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG nova.virt.images [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] f43f2d4e-45ef-42ce-9cde-789adcfd9b22 was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.part /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.part /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.converted" returned: 0 in 0.425s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.711s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:19 user nova-compute[72780]: INFO oslo.privsep.daemon [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp15cu8io/privsep.sock']
Aug 09 00:51:19 user sudo[81952]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp15cu8io/privsep.sock
Aug 09 00:51:19 user sudo[81952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Successfully created port: f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:21 user nova-compute[72780]: INFO nova.compute.claims [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Claim successful on node user
Aug 09 00:51:21 user sudo[81952]: pam_unix(sudo:session): session closed for user root
Aug 09 00:51:21 user nova-compute[72780]: INFO oslo.privsep.daemon [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Spawned new privsep daemon via rootwrap
Aug 09 00:51:21 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 00:51:21 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 00:51:21 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 00:51:21 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81963
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.124s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Creating image(s)
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.169s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk 1073741824" returned: 0 in 0.045s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.122s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.126s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.125s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk 1073741824" returned: 0 in 0.043s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Cannot resize image /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.objects.instance [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lazy-loading 'migration_context' on Instance uuid cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Ensure instance console log exists: /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Cannot resize image /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.objects.instance [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'migration_context' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Ensure instance console log exists: /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:22 user nova-compute[72780]: DEBUG nova.policy [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8412204a685048a6a787793a7266f085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb0278ced1640e9a1ab66e5cfcafc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Successfully updated port: f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquired lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-changed-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Refreshing instance network info cache due to event network-changed-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] Acquiring lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:24 user nova-compute[72780]: INFO nova.compute.claims [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Claim successful on node user
Aug 09 00:51:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Successfully created port: 94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updating instance_info_cache with network_info: [{"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Releasing lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Instance network_info: |[{"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] Acquired lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.neutron [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Refreshing network info cache for port f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Start _get_guest_xml network_info=[{"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1147958302',display_name='tempest-DeleteServersTestJSON-server-1147958302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1147958302',id=1,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='808478f7b961489f90b4ff1b5ad8f8eb',ramdisk_id='',reservation_id='r-egeg930c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-746688165',owner_user_name='tempest-DeleteServersTestJSON-746688165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:18Z,user_data=None,user_id='afa730eff7784a58b1fbe6e5d74a66cd',uuid=cac5ef5b-ca76-4c2a-89b3-7aefea704ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Converting VIF {"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lazy-loading 'pci_devices' on Instance uuid cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Creating image(s)
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "/opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:25 user nova-compute[72780]:   <uuid>cac5ef5b-ca76-4c2a-89b3-7aefea704ee4</uuid>
Aug 09 00:51:25 user nova-compute[72780]:   <name>instance-00000001</name>
Aug 09 00:51:25 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:25 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:25 user nova-compute[72780]:   <metadata>
Aug 09 00:51:25 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:25 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:25 user nova-compute[72780]:       <nova:name>tempest-DeleteServersTestJSON-server-1147958302</nova:name>
Aug 09 00:51:25 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:25</nova:creationTime>
Aug 09 00:51:25 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:25 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:25 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:25 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:user uuid="afa730eff7784a58b1fbe6e5d74a66cd">tempest-DeleteServersTestJSON-746688165-project-member</nova:user>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:project uuid="808478f7b961489f90b4ff1b5ad8f8eb">tempest-DeleteServersTestJSON-746688165</nova:project>
Aug 09 00:51:25 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:25 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:51:25 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:25 user nova-compute[72780]:         <nova:port uuid="f02894bf-9bd3-48f1-8ff1-ecb7749c76d1">
Aug 09 00:51:25 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 00:51:25 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:25 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:25 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:25 user nova-compute[72780]:   </metadata>
Aug 09 00:51:25 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:25 user nova-compute[72780]:     <system>
Aug 09 00:51:25 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:25 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:25 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:25 user nova-compute[72780]:       <entry name="serial">cac5ef5b-ca76-4c2a-89b3-7aefea704ee4</entry>
Aug 09 00:51:25 user nova-compute[72780]:       <entry name="uuid">cac5ef5b-ca76-4c2a-89b3-7aefea704ee4</entry>
Aug 09 00:51:25 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:25 user nova-compute[72780]:     </system>
Aug 09 00:51:25 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:25 user nova-compute[72780]:   <os>
Aug 09 00:51:25 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:25 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:25 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:25 user nova-compute[72780]:   </os>
Aug 09 00:51:25 user nova-compute[72780]:   <features>
Aug 09 00:51:25 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:25 user nova-compute[72780]:     <apic/>
Aug 09 00:51:25 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:25 user nova-compute[72780]:   </features>
Aug 09 00:51:25 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:25 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:25 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:25 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:25 user nova-compute[72780]:   </clock>
Aug 09 00:51:25 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:25 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:25 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:25 user nova-compute[72780]:   </cpu>
Aug 09 00:51:25 user nova-compute[72780]:   <devices>
Aug 09 00:51:25 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:25 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:25 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk"/>
Aug 09 00:51:25 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:51:25 user nova-compute[72780]:     </disk>
Aug 09 00:51:25 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:25 user nova-compute[72780]:       <mac address="fa:16:3e:f0:d4:97"/>
Aug 09 00:51:25 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:25 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:25 user nova-compute[72780]:       <target dev="tapf02894bf-9b"/>
Aug 09 00:51:25 user nova-compute[72780]:     </interface>
Aug 09 00:51:25 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:25 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/console.log" append="off"/>
Aug 09 00:51:25 user nova-compute[72780]:     </serial>
Aug 09 00:51:25 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:25 user nova-compute[72780]:     <video>
Aug 09 00:51:25 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:25 user nova-compute[72780]:     </video>
Aug 09 00:51:25 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:25 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:25 user nova-compute[72780]:     </rng>
Aug 09 00:51:25 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:25 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:25 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:25 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:25 user nova-compute[72780]:   </devices>
Aug 09 00:51:25 user nova-compute[72780]: </domain>
Aug 09 00:51:25 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1147958302',display_name='tempest-DeleteServersTestJSON-server-1147958302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1147958302',id=1,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='808478f7b961489f90b4ff1b5ad8f8eb',ramdisk_id='',reservation_id='r-egeg930c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-746688165',owner_user_name='tempest-DeleteServersTestJSON-746688165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:18Z,user_data=None,user_id='afa730eff7784a58b1fbe6e5d74a66cd',uuid=cac5ef5b-ca76-4c2a-89b3-7aefea704ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Converting VIF {"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG os_vif [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Created schema index Interface.name {{(pid=72780) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Created schema index Port.name {{(pid=72780) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Created schema index Bridge.name {{(pid=72780) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [POLLOUT] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:25 user nova-compute[72780]: INFO oslo.privsep.daemon [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8iworu23/privsep.sock']
Aug 09 00:51:25 user sudo[82012]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8iworu23/privsep.sock
Aug 09 00:51:25 user sudo[82012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.118s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk 1073741824" returned: 0 in 0.042s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.policy [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c93725c6c7e4001b478b1c87d6ba759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d09b1579894f47877a117276c7465f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Cannot resize image /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'migration_context' on Instance uuid 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Ensure instance console log exists: /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG nova.network.neutron [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updated VIF entry in instance network info cache for port f02894bf-9bd3-48f1-8ff1-ecb7749c76d1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG nova.network.neutron [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updating instance_info_cache with network_info: [{"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4b212fa3-a811-4000-a37c-b4f5688530db req-77e63c7f-86d5-478c-a069-9406190a6eaa service nova] Releasing lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:27 user sudo[82012]: pam_unix(sudo:session): session closed for user root
Aug 09 00:51:27 user nova-compute[72780]: INFO oslo.privsep.daemon [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Spawned new privsep daemon via rootwrap
Aug 09 00:51:27 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 00:51:27 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 00:51:27 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 00:51:27 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82029
Aug 09 00:51:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf02894bf-9b, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf02894bf-9b, col_values=(('external_ids', {'iface-id': 'f02894bf-9bd3-48f1-8ff1-ecb7749c76d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:d4:97', 'vm-uuid': 'cac5ef5b-ca76-4c2a-89b3-7aefea704ee4'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:27 user nova-compute[72780]: INFO os_vif [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b')
Aug 09 00:51:27 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Successfully created port: 3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] No VIF found with MAC fa:16:3e:f0:d4:97, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Successfully updated port: 94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-changed-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Refreshing instance network info cache due to event network-changed-94a22dc3-1499-42f5-8229-ce152758ea73. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance network_info: |[{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Refreshing network info cache for port 94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Start _get_guest_xml network_info=[{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:29 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:29 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-699159265',display_name='tempest-ServerActionsTestOtherA-server-699159265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-699159265',id=2,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-2qcxlys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=c57928fc-08eb-407f-9e94-baf32611ac9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.objects.instance [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'pci_devices' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:30 user nova-compute[72780]:   <uuid>c57928fc-08eb-407f-9e94-baf32611ac9e</uuid>
Aug 09 00:51:30 user nova-compute[72780]:   <name>instance-00000002</name>
Aug 09 00:51:30 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:30 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:30 user nova-compute[72780]:   <metadata>
Aug 09 00:51:30 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:30 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:30 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherA-server-699159265</nova:name>
Aug 09 00:51:30 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:29</nova:creationTime>
Aug 09 00:51:30 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:30 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:30 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:30 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:user uuid="8412204a685048a6a787793a7266f085">tempest-ServerActionsTestOtherA-1294078380-project-member</nova:user>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:project uuid="8eb0278ced1640e9a1ab66e5cfcafc8f">tempest-ServerActionsTestOtherA-1294078380</nova:project>
Aug 09 00:51:30 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:30 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:51:30 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:30 user nova-compute[72780]:         <nova:port uuid="94a22dc3-1499-42f5-8229-ce152758ea73">
Aug 09 00:51:30 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 00:51:30 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:30 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:30 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:30 user nova-compute[72780]:   </metadata>
Aug 09 00:51:30 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:30 user nova-compute[72780]:     <system>
Aug 09 00:51:30 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:30 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:30 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:30 user nova-compute[72780]:       <entry name="serial">c57928fc-08eb-407f-9e94-baf32611ac9e</entry>
Aug 09 00:51:30 user nova-compute[72780]:       <entry name="uuid">c57928fc-08eb-407f-9e94-baf32611ac9e</entry>
Aug 09 00:51:30 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:30 user nova-compute[72780]:     </system>
Aug 09 00:51:30 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:30 user nova-compute[72780]:   <os>
Aug 09 00:51:30 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:30 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:30 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:30 user nova-compute[72780]:   </os>
Aug 09 00:51:30 user nova-compute[72780]:   <features>
Aug 09 00:51:30 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:30 user nova-compute[72780]:     <apic/>
Aug 09 00:51:30 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:30 user nova-compute[72780]:   </features>
Aug 09 00:51:30 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:30 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:30 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:30 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:30 user nova-compute[72780]:   </clock>
Aug 09 00:51:30 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:30 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:30 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:30 user nova-compute[72780]:   </cpu>
Aug 09 00:51:30 user nova-compute[72780]:   <devices>
Aug 09 00:51:30 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:30 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:30 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk"/>
Aug 09 00:51:30 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:51:30 user nova-compute[72780]:     </disk>
Aug 09 00:51:30 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:30 user nova-compute[72780]:       <mac address="fa:16:3e:7b:29:0d"/>
Aug 09 00:51:30 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:30 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:30 user nova-compute[72780]:       <target dev="tap94a22dc3-14"/>
Aug 09 00:51:30 user nova-compute[72780]:     </interface>
Aug 09 00:51:30 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:30 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/console.log" append="off"/>
Aug 09 00:51:30 user nova-compute[72780]:     </serial>
Aug 09 00:51:30 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:30 user nova-compute[72780]:     <video>
Aug 09 00:51:30 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:30 user nova-compute[72780]:     </video>
Aug 09 00:51:30 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:30 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:30 user nova-compute[72780]:     </rng>
Aug 09 00:51:30 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:30 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:30 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:30 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:30 user nova-compute[72780]:   </devices>
Aug 09 00:51:30 user nova-compute[72780]: </domain>
Aug 09 00:51:30 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-699159265',display_name='tempest-ServerActionsTestOtherA-server-699159265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-699159265',id=2,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-2qcxlys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=c57928fc-08eb-407f-9e94-baf32611ac9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG os_vif [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94a22dc3-14, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94a22dc3-14, col_values=(('external_ids', {'iface-id': '94a22dc3-1499-42f5-8229-ce152758ea73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:29:0d', 'vm-uuid': 'c57928fc-08eb-407f-9e94-baf32611ac9e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:30 user nova-compute[72780]: INFO os_vif [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14')
Aug 09 00:51:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No VIF found with MAC fa:16:3e:7b:29:0d, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Successfully updated port: 3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-changed-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Refreshing instance network info cache due to event network-changed-3b83895c-c78a-4760-87f4-8027547ed305. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] Acquiring lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542291.077486, cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] VM Resumed (Lifecycle Event)
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Instance spawned successfully.
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updated VIF entry in instance network info cache for port 94a22dc3-1499-42f5-8229-ce152758ea73. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32ba01a2-7265-4ec9-be95-f7d622ca156c req-8ed6b51c-7cab-4210-bbd5-65cc36072246 service nova] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542291.0815883, cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] VM Started (Lifecycle Event)
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Took 13.30 seconds to spawn the instance on the hypervisor.
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.manager [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Took 14.14 seconds to build instance.
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-156e7432-9ec2-430e-a9f0-d242753fef96 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.333s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:31 user nova-compute[72780]: INFO nova.compute.claims [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Claim successful on node user
Aug 09 00:51:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updating instance_info_cache with network_info: [{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Instance network_info: |[{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] Acquired lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.neutron [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Refreshing network info cache for port 3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Start _get_guest_xml network_info=[{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:32 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:32 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591088295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591088295',id=3,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-300tr7qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:25Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=81f5333f-3c4f-4eb7-a1f5-65fd712ee84d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'pci_devices' on Instance uuid 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:32 user nova-compute[72780]:   <uuid>81f5333f-3c4f-4eb7-a1f5-65fd712ee84d</uuid>
Aug 09 00:51:32 user nova-compute[72780]:   <name>instance-00000003</name>
Aug 09 00:51:32 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:32 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:32 user nova-compute[72780]:   <metadata>
Aug 09 00:51:32 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:32 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:32 user nova-compute[72780]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1591088295</nova:name>
Aug 09 00:51:32 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:32</nova:creationTime>
Aug 09 00:51:32 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:32 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:32 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:32 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:user uuid="4c93725c6c7e4001b478b1c87d6ba759">tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member</nova:user>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:project uuid="b3d09b1579894f47877a117276c7465f">tempest-ServerBootFromVolumeStableRescueTest-1823004913</nova:project>
Aug 09 00:51:32 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:32 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:51:32 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:32 user nova-compute[72780]:         <nova:port uuid="3b83895c-c78a-4760-87f4-8027547ed305">
Aug 09 00:51:32 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 00:51:32 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:32 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:32 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:32 user nova-compute[72780]:   </metadata>
Aug 09 00:51:32 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:32 user nova-compute[72780]:     <system>
Aug 09 00:51:32 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:32 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:32 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:32 user nova-compute[72780]:       <entry name="serial">81f5333f-3c4f-4eb7-a1f5-65fd712ee84d</entry>
Aug 09 00:51:32 user nova-compute[72780]:       <entry name="uuid">81f5333f-3c4f-4eb7-a1f5-65fd712ee84d</entry>
Aug 09 00:51:32 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:32 user nova-compute[72780]:     </system>
Aug 09 00:51:32 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:32 user nova-compute[72780]:   <os>
Aug 09 00:51:32 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:32 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:32 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:32 user nova-compute[72780]:   </os>
Aug 09 00:51:32 user nova-compute[72780]:   <features>
Aug 09 00:51:32 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:32 user nova-compute[72780]:     <apic/>
Aug 09 00:51:32 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:32 user nova-compute[72780]:   </features>
Aug 09 00:51:32 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:32 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:32 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:32 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:32 user nova-compute[72780]:   </clock>
Aug 09 00:51:32 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:32 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:32 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:32 user nova-compute[72780]:   </cpu>
Aug 09 00:51:32 user nova-compute[72780]:   <devices>
Aug 09 00:51:32 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:32 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:32 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk"/>
Aug 09 00:51:32 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:51:32 user nova-compute[72780]:     </disk>
Aug 09 00:51:32 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:32 user nova-compute[72780]:       <mac address="fa:16:3e:5e:44:de"/>
Aug 09 00:51:32 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:32 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:32 user nova-compute[72780]:       <target dev="tap3b83895c-c7"/>
Aug 09 00:51:32 user nova-compute[72780]:     </interface>
Aug 09 00:51:32 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:32 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/console.log" append="off"/>
Aug 09 00:51:32 user nova-compute[72780]:     </serial>
Aug 09 00:51:32 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:32 user nova-compute[72780]:     <video>
Aug 09 00:51:32 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:32 user nova-compute[72780]:     </video>
Aug 09 00:51:32 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:32 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:32 user nova-compute[72780]:     </rng>
Aug 09 00:51:32 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:32 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:32 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:32 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:32 user nova-compute[72780]:   </devices>
Aug 09 00:51:32 user nova-compute[72780]: </domain>
Aug 09 00:51:32 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591088295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591088295',id=3,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-300tr7qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:25Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=81f5333f-3c4f-4eb7-a1f5-65fd712ee84d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG os_vif [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b83895c-c7, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b83895c-c7, col_values=(('external_ids', {'iface-id': '3b83895c-c78a-4760-87f4-8027547ed305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:44:de', 'vm-uuid': '81f5333f-3c4f-4eb7-a1f5-65fd712ee84d'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:32 user nova-compute[72780]: INFO os_vif [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7')
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Creating image(s)
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No VIF found with MAC fa:16:3e:5e:44:de, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.policy [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f38504b4e824e7ea66ab9e8c56f0b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ce26fa1a3947488856bfd876571471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.177s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] No waiting events found dispatching network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:32 user nova-compute[72780]: WARNING nova.compute.manager [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received unexpected event network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 for instance with vm_state active and task_state None.
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] No waiting events found dispatching network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:32 user nova-compute[72780]: WARNING nova.compute.manager [req-f70703ae-938c-4405-bd41-f149db69b530 req-72b5b31b-31d8-4082-a56d-e4bb0d0cc3c7 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received unexpected event network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 for instance with vm_state active and task_state None.
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk 1073741824" returned: 0 in 0.256s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Cannot resize image /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'migration_context' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Ensure instance console log exists: /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542294.2146156, c57928fc-08eb-407f-9e94-baf32611ac9e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] VM Resumed (Lifecycle Event)
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance spawned successfully.
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542294.2260492, c57928fc-08eb-407f-9e94-baf32611ac9e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] VM Started (Lifecycle Event)
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Took 12.33 seconds to spawn the instance on the hypervisor.
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.network.neutron [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updated VIF entry in instance network info cache for port 3b83895c-c78a-4760-87f4-8027547ed305. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG nova.network.neutron [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updating instance_info_cache with network_info: [{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5ffe85cf-48e9-441e-ab62-8f7ed8f246e7 req-3c86ac12-faeb-40b1-95b4-efde68f3f4a0 service nova] Releasing lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:34 user nova-compute[72780]: INFO nova.compute.manager [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Took 13.05 seconds to build instance.
Aug 09 00:51:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af397fca-30bf-4a66-8bbf-b8182004feff tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.422s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-e13cebbb-28d3-4cde-8402-abc27d24906c req-6896c709-3ead-4788-892e-d60dd84ec49c service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e13cebbb-28d3-4cde-8402-abc27d24906c req-6896c709-3ead-4788-892e-d60dd84ec49c service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e13cebbb-28d3-4cde-8402-abc27d24906c req-6896c709-3ead-4788-892e-d60dd84ec49c service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e13cebbb-28d3-4cde-8402-abc27d24906c req-6896c709-3ead-4788-892e-d60dd84ec49c service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-e13cebbb-28d3-4cde-8402-abc27d24906c req-6896c709-3ead-4788-892e-d60dd84ec49c service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:35 user nova-compute[72780]: WARNING nova.compute.manager [req-e13cebbb-28d3-4cde-8402-abc27d24906c req-6896c709-3ead-4788-892e-d60dd84ec49c service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state active and task_state None.
Aug 09 00:51:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-99778808-317e-4941-a0a4-3f54b78642e2 req-8d8f0d1c-f79f-482c-b18f-4c25d6e05c9b service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-99778808-317e-4941-a0a4-3f54b78642e2 req-8d8f0d1c-f79f-482c-b18f-4c25d6e05c9b service nova] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-99778808-317e-4941-a0a4-3f54b78642e2 req-8d8f0d1c-f79f-482c-b18f-4c25d6e05c9b service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-99778808-317e-4941-a0a4-3f54b78642e2 req-8d8f0d1c-f79f-482c-b18f-4c25d6e05c9b service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-99778808-317e-4941-a0a4-3f54b78642e2 req-8d8f0d1c-f79f-482c-b18f-4c25d6e05c9b service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] No waiting events found dispatching network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:35 user nova-compute[72780]: WARNING nova.compute.manager [req-99778808-317e-4941-a0a4-3f54b78642e2 req-8d8f0d1c-f79f-482c-b18f-4c25d6e05c9b service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received unexpected event network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 for instance with vm_state building and task_state spawning.
Aug 09 00:51:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Successfully created port: fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542297.1553202, 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] VM Resumed (Lifecycle Event)
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Instance spawned successfully.
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542297.160914, 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] VM Started (Lifecycle Event)
Aug 09 00:51:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-a1a2ec2c-edfa-4f1b-bb59-587472d66ffd req-c880c309-0695-4600-abf4-705883c8816c service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a1a2ec2c-edfa-4f1b-bb59-587472d66ffd req-c880c309-0695-4600-abf4-705883c8816c service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a1a2ec2c-edfa-4f1b-bb59-587472d66ffd req-c880c309-0695-4600-abf4-705883c8816c service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a1a2ec2c-edfa-4f1b-bb59-587472d66ffd req-c880c309-0695-4600-abf4-705883c8816c service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-a1a2ec2c-edfa-4f1b-bb59-587472d66ffd req-c880c309-0695-4600-abf4-705883c8816c service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:37 user nova-compute[72780]: WARNING nova.compute.manager [req-a1a2ec2c-edfa-4f1b-bb59-587472d66ffd req-c880c309-0695-4600-abf4-705883c8816c service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state active and task_state None.
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Took 11.93 seconds to spawn the instance on the hypervisor.
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:37 user nova-compute[72780]: INFO nova.compute.manager [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Took 12.78 seconds to build instance.
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4b07babd-a0db-43bd-9b9a-6319e292c6d7 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.910s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-af28a2ad-5226-4c58-b969-1263809b9e91 req-20f64380-abb5-4561-8746-9f5d82482138 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af28a2ad-5226-4c58-b969-1263809b9e91 req-20f64380-abb5-4561-8746-9f5d82482138 service nova] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af28a2ad-5226-4c58-b969-1263809b9e91 req-20f64380-abb5-4561-8746-9f5d82482138 service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af28a2ad-5226-4c58-b969-1263809b9e91 req-20f64380-abb5-4561-8746-9f5d82482138 service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-af28a2ad-5226-4c58-b969-1263809b9e91 req-20f64380-abb5-4561-8746-9f5d82482138 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] No waiting events found dispatching network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:37 user nova-compute[72780]: WARNING nova.compute.manager [req-af28a2ad-5226-4c58-b969-1263809b9e91 req-20f64380-abb5-4561-8746-9f5d82482138 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received unexpected event network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 for instance with vm_state active and task_state None.
Aug 09 00:51:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Successfully updated port: fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-changed-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Refreshing instance network info cache due to event network-changed-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance network_info: |[{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.network.neutron [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Refreshing network info cache for port fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start _get_guest_xml network_info=[{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'pci_devices' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:42 user nova-compute[72780]:   <uuid>1928c3a6-c836-4487-bc21-5eb902fb61fa</uuid>
Aug 09 00:51:42 user nova-compute[72780]:   <name>instance-00000004</name>
Aug 09 00:51:42 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:42 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:42 user nova-compute[72780]:   <metadata>
Aug 09 00:51:42 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:42 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:42 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeTestJSON-server-1294527405</nova:name>
Aug 09 00:51:42 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:42</nova:creationTime>
Aug 09 00:51:42 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:42 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:42 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:42 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:user uuid="3f38504b4e824e7ea66ab9e8c56f0b50">tempest-AttachVolumeTestJSON-760573544-project-member</nova:user>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:project uuid="32ce26fa1a3947488856bfd876571471">tempest-AttachVolumeTestJSON-760573544</nova:project>
Aug 09 00:51:42 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:42 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:51:42 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:42 user nova-compute[72780]:         <nova:port uuid="fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2">
Aug 09 00:51:42 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 00:51:42 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:42 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:42 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:42 user nova-compute[72780]:   </metadata>
Aug 09 00:51:42 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:42 user nova-compute[72780]:     <system>
Aug 09 00:51:42 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:42 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:42 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:42 user nova-compute[72780]:       <entry name="serial">1928c3a6-c836-4487-bc21-5eb902fb61fa</entry>
Aug 09 00:51:42 user nova-compute[72780]:       <entry name="uuid">1928c3a6-c836-4487-bc21-5eb902fb61fa</entry>
Aug 09 00:51:42 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:42 user nova-compute[72780]:     </system>
Aug 09 00:51:42 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:42 user nova-compute[72780]:   <os>
Aug 09 00:51:42 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:42 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:42 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:42 user nova-compute[72780]:   </os>
Aug 09 00:51:42 user nova-compute[72780]:   <features>
Aug 09 00:51:42 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:42 user nova-compute[72780]:     <apic/>
Aug 09 00:51:42 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:42 user nova-compute[72780]:   </features>
Aug 09 00:51:42 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:42 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:42 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:42 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:42 user nova-compute[72780]:   </clock>
Aug 09 00:51:42 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:42 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:42 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:42 user nova-compute[72780]:   </cpu>
Aug 09 00:51:42 user nova-compute[72780]:   <devices>
Aug 09 00:51:42 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:42 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:42 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk"/>
Aug 09 00:51:42 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:51:42 user nova-compute[72780]:     </disk>
Aug 09 00:51:42 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:42 user nova-compute[72780]:       <mac address="fa:16:3e:cb:2c:84"/>
Aug 09 00:51:42 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:42 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:42 user nova-compute[72780]:       <target dev="tapfc2b5d5d-b7"/>
Aug 09 00:51:42 user nova-compute[72780]:     </interface>
Aug 09 00:51:42 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:42 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/console.log" append="off"/>
Aug 09 00:51:42 user nova-compute[72780]:     </serial>
Aug 09 00:51:42 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:42 user nova-compute[72780]:     <video>
Aug 09 00:51:42 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:42 user nova-compute[72780]:     </video>
Aug 09 00:51:42 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:42 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:42 user nova-compute[72780]:     </rng>
Aug 09 00:51:42 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:42 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:42 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:42 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:42 user nova-compute[72780]:   </devices>
Aug 09 00:51:42 user nova-compute[72780]: </domain>
Aug 09 00:51:42 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG os_vif [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc2b5d5d-b7, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc2b5d5d-b7, col_values=(('external_ids', {'iface-id': 'fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:2c:84', 'vm-uuid': '1928c3a6-c836-4487-bc21-5eb902fb61fa'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:42 user nova-compute[72780]: INFO os_vif [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7')
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No VIF found with MAC fa:16:3e:cb:2c:84, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:43 user nova-compute[72780]: DEBUG nova.network.neutron [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updated VIF entry in instance network info cache for port fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:43 user nova-compute[72780]: DEBUG nova.network.neutron [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0d8bcc7d-878e-483f-a5f9-495ba4772d7d req-1409c486-c94f-416f-8533-b51d1755e32f service nova] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-1e924909-f890-4ee7-b05e-bd5431a73d98 req-af3fa60f-c205-406e-b9f9-a1bff712c121 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e924909-f890-4ee7-b05e-bd5431a73d98 req-af3fa60f-c205-406e-b9f9-a1bff712c121 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e924909-f890-4ee7-b05e-bd5431a73d98 req-af3fa60f-c205-406e-b9f9-a1bff712c121 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e924909-f890-4ee7-b05e-bd5431a73d98 req-af3fa60f-c205-406e-b9f9-a1bff712c121 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-1e924909-f890-4ee7-b05e-bd5431a73d98 req-af3fa60f-c205-406e-b9f9-a1bff712c121 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:45 user nova-compute[72780]: WARNING nova.compute.manager [req-1e924909-f890-4ee7-b05e-bd5431a73d98 req-af3fa60f-c205-406e-b9f9-a1bff712c121 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state building and task_state spawning.
Aug 09 00:51:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542307.2907035, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Resumed (Lifecycle Event)
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance spawned successfully.
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542307.291002, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Started (Lifecycle Event)
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Took 15.19 seconds to spawn the instance on the hypervisor.
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-49614b25-74a9-485f-a34f-ed6d72a6a689 req-e317e6ee-a0f9-4593-9dad-7149dcb55c40 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49614b25-74a9-485f-a34f-ed6d72a6a689 req-e317e6ee-a0f9-4593-9dad-7149dcb55c40 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49614b25-74a9-485f-a34f-ed6d72a6a689 req-e317e6ee-a0f9-4593-9dad-7149dcb55c40 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49614b25-74a9-485f-a34f-ed6d72a6a689 req-e317e6ee-a0f9-4593-9dad-7149dcb55c40 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-49614b25-74a9-485f-a34f-ed6d72a6a689 req-e317e6ee-a0f9-4593-9dad-7149dcb55c40 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:51:47 user nova-compute[72780]: WARNING nova.compute.manager [req-49614b25-74a9-485f-a34f-ed6d72a6a689 req-e317e6ee-a0f9-4593-9dad-7149dcb55c40 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state building and task_state spawning.
Aug 09 00:51:47 user nova-compute[72780]: INFO nova.compute.manager [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Took 16.25 seconds to build instance.
Aug 09 00:51:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8f0043cb-5921-4b41-8382-cea175a916cd tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.396s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:52 user nova-compute[72780]: INFO nova.compute.claims [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Claim successful on node user
Aug 09 00:51:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.321s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:53 user nova-compute[72780]: INFO nova.compute.claims [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Claim successful on node user
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:53 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.policy [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29f03239c6ad4689b36cf7b3ebe65d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a246ec7574c03a37e420bdfa68ebd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:53 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Creating image(s)
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "/opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "/opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "536fbddef1f7485e69c60cde24e3a6891f199c3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "536fbddef1f7485e69c60cde24e3a6891f199c3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:54 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Successfully created port: cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.part --force-share --output=json" returned: 0 in 0.210s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.virt.images [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] fc963ee7-8c25-4ef2-ae17-73b2b19490f1 was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.part /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.policy [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a00e288c883f430da675cb411b89ea7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62122e1504ff4708aa4510646bbccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:54 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Creating image(s)
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "/opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "/opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "/opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:51:54 user nova-compute[72780]: INFO nova.compute.claims [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Claim successful on node user
Aug 09 00:51:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.part /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.converted" returned: 0 in 0.378s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.183s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk 1073741824" returned: 0 in 0.056s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "536fbddef1f7485e69c60cde24e3a6891f199c3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.456s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "536fbddef1f7485e69c60cde24e3a6891f199c3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "536fbddef1f7485e69c60cde24e3a6891f199c3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Cannot resize image /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lazy-loading 'migration_context' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e,backing_fmt=raw /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Ensure instance console log exists: /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e,backing_fmt=raw /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk 1073741824" returned: 0 in 0.059s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "536fbddef1f7485e69c60cde24e3a6891f199c3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Successfully updated port: cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquired lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-changed-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Refreshing instance network info cache due to event network-changed-cdcb5023-00c6-4098-9205-e770c82ffdea. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] Acquiring lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.051s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e --force-share --output=json" returned: 0 in 0.212s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:51:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Cannot resize image /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lazy-loading 'migration_context' on Instance uuid 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Ensure instance console log exists: /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.policy [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f1daff87854ba49adc00cd53ae85f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a75d1aa47c4c2580cf976ecc9be560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:51:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Creating image(s)
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:55 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Successfully created port: 2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updating instance_info_cache with network_info: [{"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Releasing lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Instance network_info: |[{"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] Acquired lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.neutron [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Refreshing network info cache for port cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Start _get_guest_xml network_info=[{"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:51:45Z,direct_url=<?>,disk_format='qcow2',id=fc963ee7-8c25-4ef2-ae17-73b2b19490f1,min_disk=0,min_ram=0,name='',owner='b81800754fdf4e25a81044a51e8319af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:51:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'image_id': 'fc963ee7-8c25-4ef2-ae17-73b2b19490f1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.203s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:51:45Z,direct_url=<?>,disk_format='qcow2',id=fc963ee7-8c25-4ef2-ae17-73b2b19490f1,min_disk=0,min_ram=0,name='',owner='b81800754fdf4e25a81044a51e8319af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:51:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1857886325',display_name='tempest-AttachSCSIVolumeTestJSON-server-1857886325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1857886325',id=5,image_ref='fc963ee7-8c25-4ef2-ae17-73b2b19490f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfnuhxZegHLjj7Af1Sldl2E+NouDwEzPx1X5PiPCRI3k+cjzqvC5QCBqX1GgoEMPUBZsOGQ4vTtx4sGhrLIjt0xcLQ2Uj8MY0usYRFdXOgAarBPcHnc1sj/mH/HdtXStg==',key_name='tempest-keypair-287614061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27a246ec7574c03a37e420bdfa68ebd',ramdisk_id='',reservation_id='r-0md68je0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc963ee7-8c25-4ef2-ae17-73b2b19490f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1349278350',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1349278350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f03239c6ad4689b36cf7b3ebe65d80',uuid=3d08d366-e309-4fb6-a784-6e160822b587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Converting VIF {"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:56 user nova-compute[72780]:   <uuid>3d08d366-e309-4fb6-a784-6e160822b587</uuid>
Aug 09 00:51:56 user nova-compute[72780]:   <name>instance-00000005</name>
Aug 09 00:51:56 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:56 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:56 user nova-compute[72780]:   <metadata>
Aug 09 00:51:56 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:56 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:56 user nova-compute[72780]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1857886325</nova:name>
Aug 09 00:51:56 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:56</nova:creationTime>
Aug 09 00:51:56 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:56 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:56 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:56 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:user uuid="29f03239c6ad4689b36cf7b3ebe65d80">tempest-AttachSCSIVolumeTestJSON-1349278350-project-member</nova:user>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:project uuid="b27a246ec7574c03a37e420bdfa68ebd">tempest-AttachSCSIVolumeTestJSON-1349278350</nova:project>
Aug 09 00:51:56 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:56 user nova-compute[72780]:       <nova:root type="image" uuid="fc963ee7-8c25-4ef2-ae17-73b2b19490f1"/>
Aug 09 00:51:56 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:56 user nova-compute[72780]:         <nova:port uuid="cdcb5023-00c6-4098-9205-e770c82ffdea">
Aug 09 00:51:56 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 00:51:56 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:56 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:56 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:56 user nova-compute[72780]:   </metadata>
Aug 09 00:51:56 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:56 user nova-compute[72780]:     <system>
Aug 09 00:51:56 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:56 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:56 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:56 user nova-compute[72780]:       <entry name="serial">3d08d366-e309-4fb6-a784-6e160822b587</entry>
Aug 09 00:51:56 user nova-compute[72780]:       <entry name="uuid">3d08d366-e309-4fb6-a784-6e160822b587</entry>
Aug 09 00:51:56 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:56 user nova-compute[72780]:     </system>
Aug 09 00:51:56 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:56 user nova-compute[72780]:   <os>
Aug 09 00:51:56 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:56 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:56 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:56 user nova-compute[72780]:   </os>
Aug 09 00:51:56 user nova-compute[72780]:   <features>
Aug 09 00:51:56 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:56 user nova-compute[72780]:     <apic/>
Aug 09 00:51:56 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:56 user nova-compute[72780]:   </features>
Aug 09 00:51:56 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:56 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:56 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:56 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:56 user nova-compute[72780]:   </clock>
Aug 09 00:51:56 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:56 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:56 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:56 user nova-compute[72780]:   </cpu>
Aug 09 00:51:56 user nova-compute[72780]:   <devices>
Aug 09 00:51:56 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:56 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:56 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk"/>
Aug 09 00:51:56 user nova-compute[72780]:       <target dev="sda" bus="scsi"/>
Aug 09 00:51:56 user nova-compute[72780]:       <address type="drive" controller="0" unit="0"/>
Aug 09 00:51:56 user nova-compute[72780]:     </disk>
Aug 09 00:51:56 user nova-compute[72780]:     <disk type="file" device="cdrom">
Aug 09 00:51:56 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 00:51:56 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.config"/>
Aug 09 00:51:56 user nova-compute[72780]:       <target dev="sdb" bus="scsi"/>
Aug 09 00:51:56 user nova-compute[72780]:       <address type="drive" controller="0" unit="1"/>
Aug 09 00:51:56 user nova-compute[72780]:     </disk>
Aug 09 00:51:56 user nova-compute[72780]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 00:51:56 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:56 user nova-compute[72780]:       <mac address="fa:16:3e:bb:6a:29"/>
Aug 09 00:51:56 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:56 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:56 user nova-compute[72780]:       <target dev="tapcdcb5023-00"/>
Aug 09 00:51:56 user nova-compute[72780]:     </interface>
Aug 09 00:51:56 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:56 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/console.log" append="off"/>
Aug 09 00:51:56 user nova-compute[72780]:     </serial>
Aug 09 00:51:56 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:56 user nova-compute[72780]:     <video>
Aug 09 00:51:56 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:56 user nova-compute[72780]:     </video>
Aug 09 00:51:56 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:56 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:56 user nova-compute[72780]:     </rng>
Aug 09 00:51:56 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:56 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:56 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:56 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:56 user nova-compute[72780]:   </devices>
Aug 09 00:51:56 user nova-compute[72780]: </domain>
Aug 09 00:51:56 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1857886325',display_name='tempest-AttachSCSIVolumeTestJSON-server-1857886325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1857886325',id=5,image_ref='fc963ee7-8c25-4ef2-ae17-73b2b19490f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfnuhxZegHLjj7Af1Sldl2E+NouDwEzPx1X5PiPCRI3k+cjzqvC5QCBqX1GgoEMPUBZsOGQ4vTtx4sGhrLIjt0xcLQ2Uj8MY0usYRFdXOgAarBPcHnc1sj/mH/HdtXStg==',key_name='tempest-keypair-287614061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27a246ec7574c03a37e420bdfa68ebd',ramdisk_id='',reservation_id='r-0md68je0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc963ee7-8c25-4ef2-ae17-73b2b19490f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1349278350',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1349278350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f03239c6ad4689b36cf7b3ebe65d80',uuid=3d08d366-e309-4fb6-a784-6e160822b587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Converting VIF {"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG os_vif [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdcb5023-00, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcdcb5023-00, col_values=(('external_ids', {'iface-id': 'cdcb5023-00c6-4098-9205-e770c82ffdea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:6a:29', 'vm-uuid': '3d08d366-e309-4fb6-a784-6e160822b587'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:56 user nova-compute[72780]: INFO os_vif [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00')
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk 1073741824" returned: 0 in 0.050s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No BDM found with device name sda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No VIF found with MAC fa:16:3e:bb:6a:29, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Using config drive
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Cannot resize image /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'migration_context' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Ensure instance console log exists: /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:51:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Creating config drive at /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.config
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa63luii6 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa63luii6" returned: 0 in 0.058s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Successfully updated port: 2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquired lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-changed-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Refreshing instance network info cache due to event network-changed-2e61c469-6072-4b94-be42-5333daa7700b. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] Acquiring lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:56 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updating instance_info_cache with network_info: [{"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Releasing lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Instance network_info: |[{"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] Acquired lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Refreshing network info cache for port 2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Start _get_guest_xml network_info=[{"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:57 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:57 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1130242028',display_name='tempest-VolumesAssistedSnapshotsTest-server-1130242028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1130242028',id=6,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCar5IszY9U0mpdnIq1MvU/uYCggW+PJ7KAWHkPRBCZ7xi6Ajb0E58O5ayUqmT25qB32v3DK5cNRdm0LQAOUXqDNvGNlQJC6TDp3GM3o5wHUBWiP/Z1b+v/fO8rZwDVMg==',key_name='tempest-keypair-811258468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62122e1504ff4708aa4510646bbccac4',ramdisk_id='',reservation_id='r-d6bhp9fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-724599358',owner_user_name='tempest-VolumesAssistedSnapshotsTest-724599358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00e288c883f430da675cb411b89ea7c',uuid=2550fbbd-c0ed-405a-b756-d834138028ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Converting VIF {"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lazy-loading 'pci_devices' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:57 user nova-compute[72780]:   <uuid>2550fbbd-c0ed-405a-b756-d834138028ad</uuid>
Aug 09 00:51:57 user nova-compute[72780]:   <name>instance-00000006</name>
Aug 09 00:51:57 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:57 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:57 user nova-compute[72780]:   <metadata>
Aug 09 00:51:57 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:57 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:57 user nova-compute[72780]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1130242028</nova:name>
Aug 09 00:51:57 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:57</nova:creationTime>
Aug 09 00:51:57 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:57 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:57 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:57 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:user uuid="a00e288c883f430da675cb411b89ea7c">tempest-VolumesAssistedSnapshotsTest-724599358-project-member</nova:user>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:project uuid="62122e1504ff4708aa4510646bbccac4">tempest-VolumesAssistedSnapshotsTest-724599358</nova:project>
Aug 09 00:51:57 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:57 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:51:57 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:57 user nova-compute[72780]:         <nova:port uuid="2e61c469-6072-4b94-be42-5333daa7700b">
Aug 09 00:51:57 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 00:51:57 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:57 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:57 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:57 user nova-compute[72780]:   </metadata>
Aug 09 00:51:57 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:57 user nova-compute[72780]:     <system>
Aug 09 00:51:57 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:57 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:57 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:57 user nova-compute[72780]:       <entry name="serial">2550fbbd-c0ed-405a-b756-d834138028ad</entry>
Aug 09 00:51:57 user nova-compute[72780]:       <entry name="uuid">2550fbbd-c0ed-405a-b756-d834138028ad</entry>
Aug 09 00:51:57 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:57 user nova-compute[72780]:     </system>
Aug 09 00:51:57 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:57 user nova-compute[72780]:   <os>
Aug 09 00:51:57 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:57 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:57 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:57 user nova-compute[72780]:   </os>
Aug 09 00:51:57 user nova-compute[72780]:   <features>
Aug 09 00:51:57 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:57 user nova-compute[72780]:     <apic/>
Aug 09 00:51:57 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:57 user nova-compute[72780]:   </features>
Aug 09 00:51:57 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:57 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:57 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:57 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:57 user nova-compute[72780]:   </clock>
Aug 09 00:51:57 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:57 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:57 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:57 user nova-compute[72780]:   </cpu>
Aug 09 00:51:57 user nova-compute[72780]:   <devices>
Aug 09 00:51:57 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:57 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:57 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk"/>
Aug 09 00:51:57 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:51:57 user nova-compute[72780]:     </disk>
Aug 09 00:51:57 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:57 user nova-compute[72780]:       <mac address="fa:16:3e:04:a5:a8"/>
Aug 09 00:51:57 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:57 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:57 user nova-compute[72780]:       <target dev="tap2e61c469-60"/>
Aug 09 00:51:57 user nova-compute[72780]:     </interface>
Aug 09 00:51:57 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:57 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/console.log" append="off"/>
Aug 09 00:51:57 user nova-compute[72780]:     </serial>
Aug 09 00:51:57 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:57 user nova-compute[72780]:     <video>
Aug 09 00:51:57 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:57 user nova-compute[72780]:     </video>
Aug 09 00:51:57 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:57 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:57 user nova-compute[72780]:     </rng>
Aug 09 00:51:57 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:57 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:57 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:57 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:57 user nova-compute[72780]:   </devices>
Aug 09 00:51:57 user nova-compute[72780]: </domain>
Aug 09 00:51:57 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1130242028',display_name='tempest-VolumesAssistedSnapshotsTest-server-1130242028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1130242028',id=6,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCar5IszY9U0mpdnIq1MvU/uYCggW+PJ7KAWHkPRBCZ7xi6Ajb0E58O5ayUqmT25qB32v3DK5cNRdm0LQAOUXqDNvGNlQJC6TDp3GM3o5wHUBWiP/Z1b+v/fO8rZwDVMg==',key_name='tempest-keypair-811258468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62122e1504ff4708aa4510646bbccac4',ramdisk_id='',reservation_id='r-d6bhp9fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-724599358',owner_user_name='tempest-VolumesAssistedSnapshotsTest-724599358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00e288c883f430da675cb411b89ea7c',uuid=2550fbbd-c0ed-405a-b756-d834138028ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Converting VIF {"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG os_vif [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e61c469-60, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e61c469-60, col_values=(('external_ids', {'iface-id': '2e61c469-6072-4b94-be42-5333daa7700b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:a5:a8', 'vm-uuid': '2550fbbd-c0ed-405a-b756-d834138028ad'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updated VIF entry in instance network info cache for port cdcb5023-00c6-4098-9205-e770c82ffdea. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updating instance_info_cache with network_info: [{"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-282a236d-792b-44f6-babe-079629a56965 req-579c2c38-149a-40e2-8808-5a54ec25f510 service nova] Releasing lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:57 user nova-compute[72780]: INFO os_vif [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60')
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Successfully created port: d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] No VIF found with MAC fa:16:3e:04:a5:a8, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updated VIF entry in instance network info cache for port 2e61c469-6072-4b94-be42-5333daa7700b. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updating instance_info_cache with network_info: [{"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7cded13b-ae4f-4fd0-9252-7e3947c49992 req-209cdb93-1e97-44e8-8895-01a15a2a3773 service nova] Releasing lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Successfully updated port: d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquired lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-changed-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Refreshing instance network info cache due to event network-changed-d4522d9f-6eba-45f7-b5df-82d8d36410bc. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] Acquiring lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Releasing lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Instance network_info: |[{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] Acquired lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.network.neutron [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Refreshing network info cache for port d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Start _get_guest_xml network_info=[{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:51:58 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:58 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:51:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'pci_devices' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:51:59 user nova-compute[72780]:   <uuid>78fd796d-5fbe-4352-9df8-7d718bc8bde2</uuid>
Aug 09 00:51:59 user nova-compute[72780]:   <name>instance-00000007</name>
Aug 09 00:51:59 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:51:59 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:51:59 user nova-compute[72780]:   <metadata>
Aug 09 00:51:59 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:51:59 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:51:59 user nova-compute[72780]:       <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:51:59 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:51:58</nova:creationTime>
Aug 09 00:51:59 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:51:59 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:51:59 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:51:59 user nova-compute[72780]:       <nova:owner>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:51:59 user nova-compute[72780]:       </nova:owner>
Aug 09 00:51:59 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:51:59 user nova-compute[72780]:       <nova:ports>
Aug 09 00:51:59 user nova-compute[72780]:         <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:51:59 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:51:59 user nova-compute[72780]:         </nova:port>
Aug 09 00:51:59 user nova-compute[72780]:       </nova:ports>
Aug 09 00:51:59 user nova-compute[72780]:     </nova:instance>
Aug 09 00:51:59 user nova-compute[72780]:   </metadata>
Aug 09 00:51:59 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:51:59 user nova-compute[72780]:     <system>
Aug 09 00:51:59 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:51:59 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:51:59 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:51:59 user nova-compute[72780]:       <entry name="serial">78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:51:59 user nova-compute[72780]:       <entry name="uuid">78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:51:59 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:51:59 user nova-compute[72780]:     </system>
Aug 09 00:51:59 user nova-compute[72780]:   </sysinfo>
Aug 09 00:51:59 user nova-compute[72780]:   <os>
Aug 09 00:51:59 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:51:59 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:51:59 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:51:59 user nova-compute[72780]:   </os>
Aug 09 00:51:59 user nova-compute[72780]:   <features>
Aug 09 00:51:59 user nova-compute[72780]:     <acpi/>
Aug 09 00:51:59 user nova-compute[72780]:     <apic/>
Aug 09 00:51:59 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:51:59 user nova-compute[72780]:   </features>
Aug 09 00:51:59 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:51:59 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:51:59 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:51:59 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:51:59 user nova-compute[72780]:   </clock>
Aug 09 00:51:59 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:51:59 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:51:59 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:51:59 user nova-compute[72780]:   </cpu>
Aug 09 00:51:59 user nova-compute[72780]:   <devices>
Aug 09 00:51:59 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:51:59 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:51:59 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk"/>
Aug 09 00:51:59 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:51:59 user nova-compute[72780]:     </disk>
Aug 09 00:51:59 user nova-compute[72780]:     <disk type="file" device="cdrom">
Aug 09 00:51:59 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 00:51:59 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config"/>
Aug 09 00:51:59 user nova-compute[72780]:       <target dev="hda" bus="ide"/>
Aug 09 00:51:59 user nova-compute[72780]:     </disk>
Aug 09 00:51:59 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:51:59 user nova-compute[72780]:       <mac address="fa:16:3e:81:35:4c"/>
Aug 09 00:51:59 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:59 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:51:59 user nova-compute[72780]:       <target dev="tapd4522d9f-6e"/>
Aug 09 00:51:59 user nova-compute[72780]:     </interface>
Aug 09 00:51:59 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:51:59 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log" append="off"/>
Aug 09 00:51:59 user nova-compute[72780]:     </serial>
Aug 09 00:51:59 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:51:59 user nova-compute[72780]:     <video>
Aug 09 00:51:59 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:51:59 user nova-compute[72780]:     </video>
Aug 09 00:51:59 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:51:59 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:51:59 user nova-compute[72780]:     </rng>
Aug 09 00:51:59 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:51:59 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:51:59 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:51:59 user nova-compute[72780]:     </memballoon>
Aug 09 00:51:59 user nova-compute[72780]:   </devices>
Aug 09 00:51:59 user nova-compute[72780]: </domain>
Aug 09 00:51:59 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG os_vif [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4522d9f-6e, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4522d9f-6e, col_values=(('external_ids', {'iface-id': 'd4522d9f-6eba-45f7-b5df-82d8d36410bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:35:4c', 'vm-uuid': '78fd796d-5fbe-4352-9df8-7d718bc8bde2'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: INFO os_vif [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e')
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No BDM found with device name hda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No VIF found with MAC fa:16:3e:81:35:4c, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:51:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Using config drive
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Creating config drive at /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config
Aug 09 00:51:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpttvkzvw1 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpttvkzvw1" returned: 0 in 0.058s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.network.neutron [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updated VIF entry in instance network info cache for port d4522d9f-6eba-45f7-b5df-82d8d36410bc. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG nova.network.neutron [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:51:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f0498445-d037-4a26-978e-7a5ba54c4af2 req-13cf038e-c78c-40d5-aa72-ffe965859f83 service nova] Releasing lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] No waiting events found dispatching network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:00 user nova-compute[72780]: WARNING nova.compute.manager [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received unexpected event network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea for instance with vm_state building and task_state spawning.
Aug 09 00:52:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] No waiting events found dispatching network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:00 user nova-compute[72780]: WARNING nova.compute.manager [req-e8ff75bc-cea0-4d1a-8f7d-0c74a1552e0f req-1f6a1ff9-53e2-4f09-813a-61c3dfdb8a99 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received unexpected event network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea for instance with vm_state building and task_state spawning.
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-609f8cc6-ae5d-4227-9f5a-0801a6f82371 req-a11a1738-f00d-4737-a877-d33755407553 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-609f8cc6-ae5d-4227-9f5a-0801a6f82371 req-a11a1738-f00d-4737-a877-d33755407553 service nova] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-609f8cc6-ae5d-4227-9f5a-0801a6f82371 req-a11a1738-f00d-4737-a877-d33755407553 service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-609f8cc6-ae5d-4227-9f5a-0801a6f82371 req-a11a1738-f00d-4737-a877-d33755407553 service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-609f8cc6-ae5d-4227-9f5a-0801a6f82371 req-a11a1738-f00d-4737-a877-d33755407553 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] No waiting events found dispatching network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:01 user nova-compute[72780]: WARNING nova.compute.manager [req-609f8cc6-ae5d-4227-9f5a-0801a6f82371 req-a11a1738-f00d-4737-a877-d33755407553 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received unexpected event network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b for instance with vm_state building and task_state spawning.
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f2717b3-2f06-4f0f-8dc5-87970bb243f2 req-c2c6d9aa-ba49-4b73-9bb7-be303a2d6145 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8f2717b3-2f06-4f0f-8dc5-87970bb243f2 req-c2c6d9aa-ba49-4b73-9bb7-be303a2d6145 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8f2717b3-2f06-4f0f-8dc5-87970bb243f2 req-c2c6d9aa-ba49-4b73-9bb7-be303a2d6145 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8f2717b3-2f06-4f0f-8dc5-87970bb243f2 req-c2c6d9aa-ba49-4b73-9bb7-be303a2d6145 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f2717b3-2f06-4f0f-8dc5-87970bb243f2 req-c2c6d9aa-ba49-4b73-9bb7-be303a2d6145 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:02 user nova-compute[72780]: WARNING nova.compute.manager [req-8f2717b3-2f06-4f0f-8dc5-87970bb243f2 req-c2c6d9aa-ba49-4b73-9bb7-be303a2d6145 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with vm_state building and task_state spawning.
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:52:02 user nova-compute[72780]: INFO nova.compute.claims [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Claim successful on node user
Aug 09 00:52:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:02 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.policy [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2a6c9796a24419bbc3efcc6cfe4a9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fada72a9624d0287b9b9727a85bf6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Creating image(s)
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "/opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "/opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "/opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-b84bca26-cfa5-4f32-9908-af870721de08 req-a1d5f37d-724d-4b60-8f3b-c976e5ba4fef service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b84bca26-cfa5-4f32-9908-af870721de08 req-a1d5f37d-724d-4b60-8f3b-c976e5ba4fef service nova] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b84bca26-cfa5-4f32-9908-af870721de08 req-a1d5f37d-724d-4b60-8f3b-c976e5ba4fef service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b84bca26-cfa5-4f32-9908-af870721de08 req-a1d5f37d-724d-4b60-8f3b-c976e5ba4fef service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-b84bca26-cfa5-4f32-9908-af870721de08 req-a1d5f37d-724d-4b60-8f3b-c976e5ba4fef service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] No waiting events found dispatching network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:03 user nova-compute[72780]: WARNING nova.compute.manager [req-b84bca26-cfa5-4f32-9908-af870721de08 req-a1d5f37d-724d-4b60-8f3b-c976e5ba4fef service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received unexpected event network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b for instance with vm_state building and task_state spawning.
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.192s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542323.5563197, 3d08d366-e309-4fb6-a784-6e160822b587 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] VM Resumed (Lifecycle Event)
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Instance spawned successfully.
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542323.5568109, 3d08d366-e309-4fb6-a784-6e160822b587 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] VM Started (Lifecycle Event)
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Took 10.23 seconds to spawn the instance on the hypervisor.
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk 1073741824" returned: 0 in 0.066s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Successfully created port: 4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:03 user nova-compute[72780]: INFO nova.compute.manager [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Took 11.28 seconds to build instance.
Aug 09 00:52:03 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ea857b1-f335-4707-a39f-3ea562941d93 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.462s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Cannot resize image /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.objects.instance [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lazy-loading 'migration_context' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Ensure instance console log exists: /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-fb24b41b-e2e3-42cf-b3ad-fa7322d94147 req-a045f13d-78d7-4575-96cd-b8c032e9d4db service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb24b41b-e2e3-42cf-b3ad-fa7322d94147 req-a045f13d-78d7-4575-96cd-b8c032e9d4db service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb24b41b-e2e3-42cf-b3ad-fa7322d94147 req-a045f13d-78d7-4575-96cd-b8c032e9d4db service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb24b41b-e2e3-42cf-b3ad-fa7322d94147 req-a045f13d-78d7-4575-96cd-b8c032e9d4db service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-fb24b41b-e2e3-42cf-b3ad-fa7322d94147 req-a045f13d-78d7-4575-96cd-b8c032e9d4db service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:04 user nova-compute[72780]: WARNING nova.compute.manager [req-fb24b41b-e2e3-42cf-b3ad-fa7322d94147 req-a045f13d-78d7-4575-96cd-b8c032e9d4db service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with vm_state building and task_state spawning.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542324.2772405, 2550fbbd-c0ed-405a-b756-d834138028ad => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] VM Resumed (Lifecycle Event)
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Instance spawned successfully.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542324.2828684, 2550fbbd-c0ed-405a-b756-d834138028ad => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] VM Started (Lifecycle Event)
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Instance spawned successfully.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Took 9.96 seconds to spawn the instance on the hypervisor.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542324.432894, 78fd796d-5fbe-4352-9df8-7d718bc8bde2 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] VM Resumed (Lifecycle Event)
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542324.433015, 78fd796d-5fbe-4352-9df8-7d718bc8bde2 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] VM Started (Lifecycle Event)
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Took 12.02 seconds to build instance.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c9f7d0b6-b4bc-4b36-962b-d5f460390db4 tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.193s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Took 8.95 seconds to spawn the instance on the hypervisor.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:04 user nova-compute[72780]: INFO nova.compute.manager [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Took 10.49 seconds to build instance.
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ef5b1824-fa1b-488f-9ede-510b7105fad7 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.625s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Successfully updated port: 4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquired lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:52:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-changed-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Refreshing instance network info cache due to event network-changed-4bc6d8b1-c27c-4e16-98c3-53903d83a899. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] Acquiring lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updating instance_info_cache with network_info: [{"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Releasing lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Instance network_info: |[{"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] Acquired lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Refreshing network info cache for port 4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Start _get_guest_xml network_info=[{"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:52:05 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:52:05 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1482642433',display_name='tempest-TestVolumeSwap-server-1482642433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1482642433',id=8,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMRkHd8JrwJtqelVvRUVsd3PhtR5IAZdP+3qbD8rTXNha46FJFpjLnWwDPKXRdkbKZ7F074TNF4PvpsWD/L/v+RZKqUM86zyOPsOIjG/QSoY7upnU8Qf+IUbBSEY5psw==',key_name='tempest-keypair-855369443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55fada72a9624d0287b9b9727a85bf6c',ramdisk_id='',reservation_id='r-he2lth62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-893846713',owner_user_name='tempest-TestVolumeSwap-893846713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2a6c9796a24419bbc3efcc6cfe4a9c0',uuid=04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Converting VIF {"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.objects.instance [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lazy-loading 'pci_devices' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:52:05 user nova-compute[72780]:   <uuid>04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e</uuid>
Aug 09 00:52:05 user nova-compute[72780]:   <name>instance-00000008</name>
Aug 09 00:52:05 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:52:05 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:52:05 user nova-compute[72780]:   <metadata>
Aug 09 00:52:05 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:52:05 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:52:05 user nova-compute[72780]:       <nova:name>tempest-TestVolumeSwap-server-1482642433</nova:name>
Aug 09 00:52:05 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:52:05</nova:creationTime>
Aug 09 00:52:05 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:52:05 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:52:05 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:52:05 user nova-compute[72780]:       <nova:owner>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:user uuid="d2a6c9796a24419bbc3efcc6cfe4a9c0">tempest-TestVolumeSwap-893846713-project-member</nova:user>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:project uuid="55fada72a9624d0287b9b9727a85bf6c">tempest-TestVolumeSwap-893846713</nova:project>
Aug 09 00:52:05 user nova-compute[72780]:       </nova:owner>
Aug 09 00:52:05 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:52:05 user nova-compute[72780]:       <nova:ports>
Aug 09 00:52:05 user nova-compute[72780]:         <nova:port uuid="4bc6d8b1-c27c-4e16-98c3-53903d83a899">
Aug 09 00:52:05 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 00:52:05 user nova-compute[72780]:         </nova:port>
Aug 09 00:52:05 user nova-compute[72780]:       </nova:ports>
Aug 09 00:52:05 user nova-compute[72780]:     </nova:instance>
Aug 09 00:52:05 user nova-compute[72780]:   </metadata>
Aug 09 00:52:05 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:52:05 user nova-compute[72780]:     <system>
Aug 09 00:52:05 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:52:05 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:52:05 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:52:05 user nova-compute[72780]:       <entry name="serial">04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e</entry>
Aug 09 00:52:05 user nova-compute[72780]:       <entry name="uuid">04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e</entry>
Aug 09 00:52:05 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:52:05 user nova-compute[72780]:     </system>
Aug 09 00:52:05 user nova-compute[72780]:   </sysinfo>
Aug 09 00:52:05 user nova-compute[72780]:   <os>
Aug 09 00:52:05 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:52:05 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:52:05 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:52:05 user nova-compute[72780]:   </os>
Aug 09 00:52:05 user nova-compute[72780]:   <features>
Aug 09 00:52:05 user nova-compute[72780]:     <acpi/>
Aug 09 00:52:05 user nova-compute[72780]:     <apic/>
Aug 09 00:52:05 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:52:05 user nova-compute[72780]:   </features>
Aug 09 00:52:05 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:52:05 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:52:05 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:52:05 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:52:05 user nova-compute[72780]:   </clock>
Aug 09 00:52:05 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:52:05 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:52:05 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:52:05 user nova-compute[72780]:   </cpu>
Aug 09 00:52:05 user nova-compute[72780]:   <devices>
Aug 09 00:52:05 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:52:05 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:52:05 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk"/>
Aug 09 00:52:05 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:52:05 user nova-compute[72780]:     </disk>
Aug 09 00:52:05 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:52:05 user nova-compute[72780]:       <mac address="fa:16:3e:5f:87:82"/>
Aug 09 00:52:05 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:52:05 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:52:05 user nova-compute[72780]:       <target dev="tap4bc6d8b1-c2"/>
Aug 09 00:52:05 user nova-compute[72780]:     </interface>
Aug 09 00:52:05 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:52:05 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/console.log" append="off"/>
Aug 09 00:52:05 user nova-compute[72780]:     </serial>
Aug 09 00:52:05 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:52:05 user nova-compute[72780]:     <video>
Aug 09 00:52:05 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:52:05 user nova-compute[72780]:     </video>
Aug 09 00:52:05 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:52:05 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:52:05 user nova-compute[72780]:     </rng>
Aug 09 00:52:05 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:52:05 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:52:05 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:52:05 user nova-compute[72780]:     </memballoon>
Aug 09 00:52:05 user nova-compute[72780]:   </devices>
Aug 09 00:52:05 user nova-compute[72780]: </domain>
Aug 09 00:52:05 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1482642433',display_name='tempest-TestVolumeSwap-server-1482642433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1482642433',id=8,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMRkHd8JrwJtqelVvRUVsd3PhtR5IAZdP+3qbD8rTXNha46FJFpjLnWwDPKXRdkbKZ7F074TNF4PvpsWD/L/v+RZKqUM86zyOPsOIjG/QSoY7upnU8Qf+IUbBSEY5psw==',key_name='tempest-keypair-855369443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55fada72a9624d0287b9b9727a85bf6c',ramdisk_id='',reservation_id='r-he2lth62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-893846713',owner_user_name='tempest-TestVolumeSwap-893846713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2a6c9796a24419bbc3efcc6cfe4a9c0',uuid=04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Converting VIF {"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG os_vif [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bc6d8b1-c2, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bc6d8b1-c2, col_values=(('external_ids', {'iface-id': '4bc6d8b1-c27c-4e16-98c3-53903d83a899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:87:82', 'vm-uuid': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:05 user nova-compute[72780]: INFO os_vif [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2')
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:52:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] No VIF found with MAC fa:16:3e:5f:87:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG nova.network.neutron [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updated VIF entry in instance network info cache for port 4bc6d8b1-c27c-4e16-98c3-53903d83a899. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG nova.network.neutron [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updating instance_info_cache with network_info: [{"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-40800d3c-95ff-4f0c-aed0-f4fd09b13fd8 req-788a3c64-654c-4400-98fe-672acfb3cc63 service nova] Releasing lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:52:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd928c15-a41e-468e-a5d9-41c81476aa9d req-63c21d07-79fd-4610-97f9-aa52365e337a service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd928c15-a41e-468e-a5d9-41c81476aa9d req-63c21d07-79fd-4610-97f9-aa52365e337a service nova] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd928c15-a41e-468e-a5d9-41c81476aa9d req-63c21d07-79fd-4610-97f9-aa52365e337a service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd928c15-a41e-468e-a5d9-41c81476aa9d req-63c21d07-79fd-4610-97f9-aa52365e337a service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd928c15-a41e-468e-a5d9-41c81476aa9d req-63c21d07-79fd-4610-97f9-aa52365e337a service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] No waiting events found dispatching network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:07 user nova-compute[72780]: WARNING nova.compute.manager [req-dd928c15-a41e-468e-a5d9-41c81476aa9d req-63c21d07-79fd-4610-97f9-aa52365e337a service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received unexpected event network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 for instance with vm_state building and task_state spawning.
Aug 09 00:52:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-635650f4-9f70-4663-881a-4e920a778085 req-ca16213a-0d84-4169-892f-5b3c4b10f45c service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-635650f4-9f70-4663-881a-4e920a778085 req-ca16213a-0d84-4169-892f-5b3c4b10f45c service nova] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-635650f4-9f70-4663-881a-4e920a778085 req-ca16213a-0d84-4169-892f-5b3c4b10f45c service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-635650f4-9f70-4663-881a-4e920a778085 req-ca16213a-0d84-4169-892f-5b3c4b10f45c service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-635650f4-9f70-4663-881a-4e920a778085 req-ca16213a-0d84-4169-892f-5b3c4b10f45c service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] No waiting events found dispatching network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:52:09 user nova-compute[72780]: WARNING nova.compute.manager [req-635650f4-9f70-4663-881a-4e920a778085 req-ca16213a-0d84-4169-892f-5b3c4b10f45c service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received unexpected event network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 for instance with vm_state building and task_state spawning.
Aug 09 00:52:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542329.9757495, 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:09 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] VM Resumed (Lifecycle Event)
Aug 09 00:52:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:52:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:52:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Instance spawned successfully.
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:52:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542329.9806318, 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:52:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] VM Started (Lifecycle Event)
Aug 09 00:52:10 user nova-compute[72780]: INFO nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:52:10 user nova-compute[72780]: INFO nova.compute.manager [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Took 7.97 seconds to build instance.
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb7d3c3-7c4b-4588-9ca0-7f04d71a2ab7 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.155s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:12 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:52:12 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7843MB free_disk=25.645587921142578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 3d08d366-e309-4fb6-a784-6e160822b587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 2550fbbd-c0ed-405a-b756-d834138028ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:52:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:52:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updating instance_info_cache with network_info: [{"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:52:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:52:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:52:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:52:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:52:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:52:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:52:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:52:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:52:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:52:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:52:56 user nova-compute[72780]: INFO nova.compute.claims [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Claim successful on node user
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 00:52:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:52:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:52:57 user nova-compute[72780]: INFO nova.virt.block_device [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Booting with volume 663bf838-36a9-4e8f-bcd1-f24f5223120e at /dev/vda
Aug 09 00:52:57 user nova-compute[72780]: DEBUG nova.policy [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c57ad9eb9fd945a6916cc31ad2557c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9858a38f25aa4dd3bbfd1a80ef16b5de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:52:57 user nova-compute[72780]: DEBUG os_brick.utils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:52:57 user nova-compute[72780]: INFO oslo.privsep.daemon [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpb2p0qhgn/privsep.sock']
Aug 09 00:52:57 user sudo[83754]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpb2p0qhgn/privsep.sock
Aug 09 00:52:57 user sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 00:52:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully created port: c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:52:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully created port: e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:52:59 user sudo[83754]: pam_unix(sudo:session): session closed for user root
Aug 09 00:52:59 user nova-compute[72780]: INFO oslo.privsep.daemon [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Spawned new privsep daemon via rootwrap
Aug 09 00:52:59 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 00:52:59 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 00:52:59 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 00:52:59 user nova-compute[72780]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83773
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a013f49e-8b71-4b37-a472-68b650953310]: (2,) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65fbc55-5abc-4644-a612-6d0129e4add3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:52:59 user nova-compute[72780]: WARNING os_brick.initiator.connectors.nvmeof [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b37a155-3ad4-47db-8a61-c15b5cbdb149]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b4ae3-3e11-4b12-9353-8d8fe237f537]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c08a4c6-d9bc-4c23-9755-b2cfe8b0b502]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:52:59 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:52:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[796dcc8c-01f4-4330-bc52-e1ea5c642b8a]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG os_brick.utils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== get_connector_properties: return (2006ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating existing volume attachment record: fb6cd6ed-3522-465c-ac52-e8a9eee8216c {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:52:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully created port: 740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully created port: f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:01 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully created port: 5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-c6cbace6-13de-46ce-a8a1-1992c6f8f091. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-51e2175c-3670-4116-ac57-f95f23fb9fab req-f5a68b98-5bf3-4d2c-a0d8-9d8ecf7810f2 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: 5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:53:03 user nova-compute[72780]: INFO nova.compute.claims [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Claim successful on node user
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:53:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: 268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:53:04 user nova-compute[72780]: INFO nova.virt.block_device [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Booting with volume 23ccf7fd-5226-44c2-98b5-f8f96d10bb23 at /dev/vda
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.policy [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcb53e6952f94e518a3b2f877c861e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '030c483139e24282b62330ed55a89250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG os_brick.utils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c9512-83dc-485b-a002-6ba687304468]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b242efa-4aab-4340-b86c-6036e099fd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb2c3a-9d2c-4d5e-a6a6-3bbe272624fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b9212-abb9-4ee2-8c7e-26f29cd327bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:04 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c7f856-d2c4-4d19-8082-8edc32ebae49]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG os_brick.utils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating existing volume attachment record: 0de40bd9-ef8a-4d10-8d83-daaedeaed4d8 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-5951788c-c1ce-4412-9d1b-2881f3efcf6d. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port 5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully created port: 0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-268dcf01-4949-4ea7-9325-985babb69a79. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port 268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully created port: dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7fd27b8-9f9d-4e08-a2dc-52db5a874a72 req-6387d433-f77e-4b31-8b7a-6388d11aff83 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: 740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully created port: 72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-e7947d80-596a-45d5-b72b-b74cbd725e55. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-740e63a0-2dcf-482e-9013-c25eda8ba97c. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port 740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully created port: 79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0bcb3671-e05e-4735-9b14-c93acf789427 req-9ec0676b-7b2e-4459-bdbf-e47c950e6534 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Successfully updated port: 5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully created port: f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: 0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-0134357c-554f-4988-a2d8-54ecd8ab6fc3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port 0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-f38f18af-55a5-47fc-8be0-4924d404eb2e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d32367e7-6705-467a-a903-54dda8329455 req-60b106dd-0efa-4535-a80c-89f34cffede3 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: 01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:53:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance network_info: |[{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-01821a48-8082-4e27-92f9-2dda759697a9. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port 01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updated VIF entry in instance network info cache for port f38f18af-55a5-47fc-8be0-4924d404eb2e. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-5c1db11d-23e2-4fce-a4e6-61364225ee37. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port 5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updated VIF entry in instance network info cache for port 5c1db11d-23e2-4fce-a4e6-61364225ee37. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a39a1fef-93d1-482f-8d9e-1287634895ce req-e11963b4-a60f-4e6f-8299-e1495b41d3e5 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-c78b4641-74a7-4ce9-b168-a3a2fb45f570. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: 72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-892508f3-bc9f-40a1-bd91-e5da8673e3db req-32b1980e-07e3-40f7-b277-9b62e6de0448 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-changed-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Refreshing instance network info cache due to event network-changed-94a22dc3-1499-42f5-8229-ce152758ea73. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Refreshing network info cache for port 94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-dcb49fde-0076-4f71-907e-b1665a019e11. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:13 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:53:13 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7327MB free_disk=25.54568862915039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: 79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 3d08d366-e309-4fb6-a784-6e160822b587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 2550fbbd-c0ed-405a-b756-d834138028ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 0e0fc6f8-5e07-421e-a841-de1c73a7b41e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance b4bad65f-909e-4a75-a4d0-bf81f89dcc84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updated VIF entry in instance network info cache for port 94a22dc3-1499-42f5-8229-ce152758ea73. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-111cf387-6e9a-43f6-b51a-29e0152d0e55 req-7d9b810f-e3f1-433e-9b96-99b16d8fb508 service nova] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:53:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-72301431-d6e6-4267-93f0-6970ab95454f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port 72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Successfully updated port: f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-485dcd47-1d32-4360-849a-4220f5b0e89b req-e805c1ea-fbb1-4e38-abf6-795be70ab692 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:53:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:53:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-79394c84-f680-4f00-9318-31684ee93095. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:16 user nova-compute[72780]: INFO nova.compute.manager [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] instance snapshotting
Aug 09 00:53:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Beginning live snapshot process
Aug 09 00:53:16 user nova-compute[72780]: INFO nova.virt.block_device [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Booting with volume 48ea1630-08b6-4e9a-9915-a23f15105d34 at /dev/vdb
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG os_brick.utils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c1b03-be65-40dc-a43e-85404a1ca229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d2844-685a-4c0f-8247-59deb8b6fc0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ac1b39-5872-4daa-83bb-5fe4d4fef459]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac91ed7-4fd3-4667-bda6-86f6f870d4f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:16 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3c21ce-1c59-4de2-aeb0-4f4a3e360ba1]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG os_brick.utils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating existing volume attachment record: 861e0ec7-4e79-4076-8014-4315ea4c3d34 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpudggskdz/bb46b2421d664fab9e18c95213dd3e96.delta 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lazy-loading 'flavor' on Instance uuid cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpudggskdz/bb46b2421d664fab9e18c95213dd3e96.delta 1073741824" returned: 0 in 0.064s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 00:53:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72780) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 00:53:16 user nova-compute[72780]: INFO nova.virt.libvirt.host [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] UEFI support detected
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance network_info: |[{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:16 user nova-compute[72780]: DEBUG nova.network.neutron [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port 79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:17 user nova-compute[72780]: INFO nova.compute.manager [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Attaching volume 6262dbe2-846d-448a-855e-92e143f90b79 to /dev/vdb
Aug 09 00:53:17 user nova-compute[72780]: DEBUG os_brick.utils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[297730a4-aec2-43e3-a78b-54b68dd5fcf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5032928-3972-40c4-9096-ff128854d13b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89845963-f478-4ba4-8134-cbd0dc94495f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f787922-c2d0-4657-9e90-0afea25fa256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:17 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9abeb9-a966-4997-9f6f-983da60fec20]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG os_brick.utils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updating existing volume attachment record: 7ae2d16c-d2c7-40b0-b578-9c558c2cdf48 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updated VIF entry in instance network info cache for port 79394c84-f680-4f00-9318-31684ee93095. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-f64598f8-c8f2-453b-bedd-4606158a87f2. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updated VIF entry in instance network info cache for port f64598f8-c8f2-453b-bedd-4606158a87f2. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53adde93-4700-40c4-a266-bdfb751df8a1 req-2960d2f9-4188-4773-b3b1-a4748ef60d31 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:53:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 00:53:18 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:53:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpudggskdz/bb46b2421d664fab9e18c95213dd3e96.delta /opt/stack/data/nova/instances/snapshots/tmpudggskdz/bb46b2421d664fab9e18c95213dd3e96 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpudggskdz/bb46b2421d664fab9e18c95213dd3e96.delta /opt/stack/data/nova/instances/snapshots/tmpudggskdz/bb46b2421d664fab9e18c95213dd3e96" returned: 0 in 0.548s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Snapshot extracted, beginning image upload
Aug 09 00:53:19 user nova-compute[72780]: INFO nova.virt.block_device [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Booting with volume 6c18dd1e-b645-4e22-81be-f90ed02a1190 at /dev/vdb
Aug 09 00:53:19 user nova-compute[72780]: DEBUG os_brick.utils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c3fc25-4e99-4ad8-b08f-930814202784]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba289e42-6276-427d-95c0-d3f38bb5e266]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f0789-2c2e-4066-9604-574a88b91c7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b4443-236c-4311-88e2-a5c5d6e24ef2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:19 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[409f8db3-30d6-407d-8090-0000b95e021f]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG os_brick.utils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:19 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating existing volume attachment record: 48671a6f-1168-4c0f-a746-53fb1caa33df {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Snapshot image upload complete
Aug 09 00:53:21 user nova-compute[72780]: INFO nova.compute.manager [None req-34a3a02e-a1f8-4c39-ad8c-487a2c134315 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Took 5.39 seconds to snapshot the instance on the hypervisor.
Aug 09 00:53:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-changed-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Refreshing instance network info cache due to event network-changed-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Refreshing network info cache for port fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updated VIF entry in instance network info cache for port fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fb87b30-f193-4943-abde-047996a0420d req-3ef087cd-0477-4669-9bb1-676f5ebf30de service nova] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:25 user nova-compute[72780]: INFO nova.virt.block_device [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Booting with volume 112126a1-e6da-4856-828f-0020706660f2 at /dev/vdc
Aug 09 00:53:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG os_brick.utils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9428074-660c-49b6-af8d-f3713a72d5dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdb7bca-5766-4356-8c9f-f522246a62b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e50aa9-8a64-4b3c-8a2c-ad68c20aeff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9671c63b-3009-4da7-857c-fb781470e3cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:25 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a134c9a-c9da-4960-b43e-e4f3487045bb]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG os_brick.utils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:25 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating existing volume attachment record: dda68143-ac82-4490-8391-dca31ce44e74 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connector [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Factory for ISCSI on None {{(pid=72780) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWGNSQjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:26 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:26 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:26 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[325d83a0-4a16-4743-9004-347cdfea433a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:26 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7c87e-453c-4829-8111-98d9525ef6b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79] added
Aug 09 00:53:26 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d1a7bb-9192-487b-9247-dbf697509db4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c0458-9429-4a51-b127-62d8e7885964]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWGNSQjE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWGNSQjE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e312b3a3-9151-4d89-b26b-0fc65a324448]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWGNSQjE'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a309bb-2942-43c5-9f0c-dec6becdabb0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc8f968-89fd-497e-b952-3a9ea3f284cc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:53:26 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:53:26 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:26 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:53:26 user nova-compute[72780]: 
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ca24a-fe38-4817-9a0f-c28d276a0fa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260]
Aug 09 00:53:26 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:26 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f190f6f9-e439-47fe-a5f0-0f3eb161124d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30bdee0-fe27-48ea-89ef-09c66cc32934]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 (non-flash)
Aug 09 00:53:26 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 (non-flash)
Aug 09 00:53:26 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8cc3df-986f-416c-9e4a-5fca46a1461a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWGNSQjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23961353730366161', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961353730366161', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lazy-loading 'flavor' on Instance uuid cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:53:27 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:27 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:53:27 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:53:27 user nova-compute[72780]:   <serial>6262dbe2-846d-448a-855e-92e143f90b79</serial>
Aug 09 00:53:27 user nova-compute[72780]: </disk>
Aug 09 00:53:27 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] No VIF found with MAC fa:16:3e:f0:d4:97, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-543e00ea-36c4-4d94-a1c2-f32e806b64ff tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.098s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:28 user nova-compute[72780]: INFO nova.compute.manager [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Terminating instance
Aug 09 00:53:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:28 user nova-compute[72780]: INFO nova.virt.block_device [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Booting with volume 5aafb0a0-3c45-47c1-8c19-8233ce92f6ab at /dev/vdc
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.utils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc18a0af-6483-40a0-b163-8543822a9a85 req-a40cdb1f-88c6-4c9e-8413-22470dd4329d service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-vif-unplugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc18a0af-6483-40a0-b163-8543822a9a85 req-a40cdb1f-88c6-4c9e-8413-22470dd4329d service nova] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc18a0af-6483-40a0-b163-8543822a9a85 req-a40cdb1f-88c6-4c9e-8413-22470dd4329d service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc18a0af-6483-40a0-b163-8543822a9a85 req-a40cdb1f-88c6-4c9e-8413-22470dd4329d service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc18a0af-6483-40a0-b163-8543822a9a85 req-a40cdb1f-88c6-4c9e-8413-22470dd4329d service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] No waiting events found dispatching network-vif-unplugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc18a0af-6483-40a0-b163-8543822a9a85 req-a40cdb1f-88c6-4c9e-8413-22470dd4329d service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-vif-unplugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[976becfe-7508-4a3f-bfbc-d49a488f44ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25453b-3999-4853-b7e9-514375524f8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc16749-e62f-411a-ab0b-6b67c2fcff57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c67f3-28a3-4eea-b6d7-fbaec8f98379]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:29 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52dfb71-4441-4eed-99b3-3d5be9520b7f]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.utils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating existing volume attachment record: b9351324-6d49-4516-b6c8-205499f9bfec {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Instance destroyed successfully.
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.objects.instance [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lazy-loading 'resources' on Instance uuid cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1147958302',display_name='tempest-DeleteServersTestJSON-server-1147958302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1147958302',id=1,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='808478f7b961489f90b4ff1b5ad8f8eb',ramdisk_id='',reservation_id='r-egeg930c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-746688165',owner_user_name='tempest-DeleteServersTestJSON-746688165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:51:31Z,user_data=None,user_id='afa730eff7784a58b1fbe6e5d74a66cd',uuid=cac5ef5b-ca76-4c2a-89b3-7aefea704ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Converting VIF {"id": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "address": "fa:16:3e:f0:d4:97", "network": {"id": "4ef2ace7-2627-422a-953b-f272dc5367aa", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-946167319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "808478f7b961489f90b4ff1b5ad8f8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02894bf-9b", "ovs_interfaceid": "f02894bf-9bd3-48f1-8ff1-ecb7749c76d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_vif [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf02894bf-9b, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:29 user nova-compute[72780]: INFO os_vif [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:d4:97,bridge_name='br-int',has_traffic_filtering=True,id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1,network=Network(4ef2ace7-2627-422a-953b-f272dc5367aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02894bf-9b')
Aug 09 00:53:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWGNSQjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6cdcbf-d415-4631-81b7-08f395326b3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f40a42-25ed-42dc-81f3-72f438c6812a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 (non-flash)
Aug 09 00:53:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 (non-flash)
Aug 09 00:53:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0656b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.099s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ebff79-9670-4398-a85d-b2373f7ff4e7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7199ce-cf6e-420d-ae30-2f409663c707]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d360e-fa26-4669-85b7-975e70cda9ff]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4413a36-b074-4992-aef0-492632853ae7]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[467fa7fb-9a79-4cab-91cb-8e259240e2d4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab78ab-cf0e-454a-a6aa-94aeda9701da]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260]
Aug 09 00:53:30 user nova-compute[72780]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6262dbe2-846d-448a-855e-92e143f90b79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a33ad1-3eed-4287-9830-3af2b378344f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] <== disconnect_volume: return (380ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:53:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Deleting instance files /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4_del
Aug 09 00:53:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Deletion of /opt/stack/data/nova/instances/cac5ef5b-ca76-4c2a-89b3-7aefea704ee4_del complete
Aug 09 00:53:30 user nova-compute[72780]: INFO nova.compute.manager [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 09 00:53:30 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:53:30 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-ddd67043-1337-4b53-b4f4-35f3a6ad0d58 req-7da2cee3-3bfb-4647-9313-1e043f5d71a2 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-vif-deleted-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:31 user nova-compute[72780]: INFO nova.compute.manager [req-ddd67043-1337-4b53-b4f4-35f3a6ad0d58 req-7da2cee3-3bfb-4647-9313-1e043f5d71a2 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Neutron deleted interface f02894bf-9bd3-48f1-8ff1-ecb7749c76d1; detaching it from the instance and deleting it from the info cache
Aug 09 00:53:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-ddd67043-1337-4b53-b4f4-35f3a6ad0d58 req-7da2cee3-3bfb-4647-9313-1e043f5d71a2 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-37db819a-b874-42d1-88ab-eb4262533a93 req-0317e836-2f30-43e2-a506-ab8cc865cdf5 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received event network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-37db819a-b874-42d1-88ab-eb4262533a93 req-0317e836-2f30-43e2-a506-ab8cc865cdf5 service nova] Acquiring lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-37db819a-b874-42d1-88ab-eb4262533a93 req-0317e836-2f30-43e2-a506-ab8cc865cdf5 service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-37db819a-b874-42d1-88ab-eb4262533a93 req-0317e836-2f30-43e2-a506-ab8cc865cdf5 service nova] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-37db819a-b874-42d1-88ab-eb4262533a93 req-0317e836-2f30-43e2-a506-ab8cc865cdf5 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] No waiting events found dispatching network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:31 user nova-compute[72780]: WARNING nova.compute.manager [req-37db819a-b874-42d1-88ab-eb4262533a93 req-0317e836-2f30-43e2-a506-ab8cc865cdf5 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Received unexpected event network-vif-plugged-f02894bf-9bd3-48f1-8ff1-ecb7749c76d1 for instance with vm_state active and task_state deleting.
Aug 09 00:53:31 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Took 0.96 seconds to deallocate network for instance.
Aug 09 00:53:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-ddd67043-1337-4b53-b4f4-35f3a6ad0d58 req-7da2cee3-3bfb-4647-9313-1e043f5d71a2 service nova] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Detach interface failed, port_id=f02894bf-9bd3-48f1-8ff1-ecb7749c76d1, reason: Instance cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:53:32 user nova-compute[72780]: INFO nova.compute.manager [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Took 1.01 seconds to detach 1 volumes for instance.
Aug 09 00:53:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:32 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:53:32 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:53:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:32 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Deleted allocations for instance cac5ef5b-ca76-4c2a-89b3-7aefea704ee4
Aug 09 00:53:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-588f60dc-7bf9-49b1-8e91-9b02f01ef681 tempest-DeleteServersTestJSON-746688165 tempest-DeleteServersTestJSON-746688165-project-member] Lock "cac5ef5b-ca76-4c2a-89b3-7aefea704ee4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.055s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.145s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:33 user nova-compute[72780]: INFO nova.compute.manager [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Attaching volume 40ddfc57-e117-427e-8bbd-8afded01812e to /dev/vdb
Aug 09 00:53:33 user nova-compute[72780]: DEBUG os_brick.utils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82de4aa2-ada4-4ee5-8d23-384bdc0dd52f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f49ac-8541-457d-b7a4-1748c2d47f07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce162d48-b8a0-443a-9e46-eea567e14ca5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[db99f270-5fa3-40bb-a8ed-df892cd6134b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:34 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3685d45-7556-4e63-ab95-d618fb132a8a]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG os_brick.utils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating existing volume attachment record: f3e33ad0-71ba-402d-b23c-5d541a624cb3 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:53:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Creating image(s)
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Ensure instance console log exists: /opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Start _get_guest_xml network_info=[{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpyYbODa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84', 'attached_at': '', 'detached_at': '', 'volume_id': '23ccf7fd-5226-44c2-98b5-f8f96d10bb23', 'serial': '23ccf7fd-5226-44c2-98b5-f8f96d10bb23'}, 'disk_bus': 'virtio', 'attachment_id': '0de40bd9-ef8a-4d10-8d83-daaedeaed4d8', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCuGEfca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84', 'attached_at': '', 'detached_at': '', 'volume_id': '48ea1630-08b6-4e9a-9915-a23f15105d34', 'serial': '48ea1630-08b6-4e9a-9915-a23f15105d34'}, 'disk_bus': 'virtio', 'attachment_id': '861e0ec7-4e79-4076-8014-4315ea4c3d34', 'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsrWHZJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84', 'attached_at': '', 'detached_at': '', 'volume_id': '112126a1-e6da-4856-828f-0020706660f2', 'serial': '112126a1-e6da-4856-828f-0020706660f2'}, 'disk_bus': 'virtio', 'attachment_id': 'dda68143-ac82-4490-8391-dca31ce44e74', 'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:53:35 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:53:35 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:53:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpyYbODa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:36 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:36 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:36 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb3195b-0994-4673-80f7-68e738aeaa00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:36 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[84193580-9263-41bb-af21-7903ae5b3451]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23] added
Aug 09 00:53:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82842825-322d-4273-8f66-007b1177c353]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ec38b-b4f0-486e-bf79-7e5938df1204]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpyYbODa {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpyYbODa" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb96e0-426d-4f0b-a641-c38bb618bde1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GpyYbODa'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8d18a-8fa8-4a1e-9d5b-c94ee46d80c2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5024603d-147b-441b-9f74-cff5fd63adf8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:53:36 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 00:53:36 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:36 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 00:53:36 user nova-compute[72780]: 
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6a3ed9-7f6a-4f31-b184-4f023821885a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260]
Aug 09 00:53:36 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e22fcdd-8efb-458b-b0f3-1ed4286cf4ec]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f24abc4-75c3-41b8-8609-1a77d39e8c66]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e26101-2f9b-47fd-afc4-49833d9c8a49]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpyYbODa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23134663462653364', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134663462653364', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCuGEfca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:37 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:37 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:37 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fed88f-6448-4133-9580-a47394715657]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:37 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b646c9-60ea-433e-aede-3d8a955feb29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34] added
Aug 09 00:53:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52aca29-a4c8-4ec4-afeb-09615eab05eb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5a7604-ac8a-4b23-b8e7-36e8fcea67c0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCuGEfca {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCuGEfca" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[080bf826-1310-4371-ac0c-173ba5a27548]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCuGEfca'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcff94c-34a0-431f-8761-22bab80695e2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb736d5-b772-42c6-b793-9f6983ff7073]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0a172-6a7d-4829-af21-b3ce7fef31c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260]
Aug 09 00:53:37 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e00f5b1-f417-4d3d-9d4a-85443112c2f3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbbc158-751a-4019-bedb-b205c9c10d2c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:37 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:37 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e2d30b-bf38-4b25-b955-fc5280afcc67]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCuGEfca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23138346537626631', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138346537626631', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsrWHZJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:38 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:38 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:38 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4197fa9-b45e-474e-b284-53cbcdb5cc34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:38 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53c297e-fbf1-44bc-85e0-4927445f7b9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2] added
Aug 09 00:53:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8858b14f-f31c-484b-ae63-c6c4258d1405]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c6ac7a-aca5-4099-b5fd-25db825b83ed]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YsrWHZJf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YsrWHZJf" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0b7bb-cf38-41d4-a537-e956b62af424]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YsrWHZJf'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09469a7-f141-4071-a8ce-01dae8fe7ad0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fc51fe-612a-4e22-b7b7-e425cce8ae18]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:38 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:38 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbedc7b-7e9b-466c-8970-152ade74f131]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260]
Aug 09 00:53:39 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc96f4e-c914-4fa8-8e92-eb01e6447f6e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f14b657-5a99-4faf-b7dd-e950fa79ae16]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:39 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:39 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:39 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:39 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[134c9b78-058d-4e4a-8a72-88bd6792c46d]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsrWHZJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:53:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Creating image(s)
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Ensure instance console log exists: /opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Start _get_guest_xml network_info=[{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAUnBGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e', 'attached_at': '', 'detached_at': '', 'volume_id': '663bf838-36a9-4e8f-bcd1-f24f5223120e', 'serial': '663bf838-36a9-4e8f-bcd1-f24f5223120e'}, 'disk_bus': 'virtio', 'attachment_id': 'fb6cd6ed-3522-465c-ac52-e8a9eee8216c', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYqgdpVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e', 'attached_at': '', 'detached_at': '', 'volume_id': '6c18dd1e-b645-4e22-81be-f90ed02a1190', 'serial': '6c18dd1e-b645-4e22-81be-f90ed02a1190'}, 'disk_bus': 'virtio', 'attachment_id': '48671a6f-1168-4c0f-a746-53fb1caa33df', 'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjfnLpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e', 'attached_at': '', 'detached_at': '', 'volume_id': '5aafb0a0-3c45-47c1-8c19-8233ce92f6ab', 'serial': '5aafb0a0-3c45-47c1-8c19-8233ce92f6ab'}, 'disk_bus': 'virtio', 'attachment_id': 'b9351324-6d49-4516-b6c8-205499f9bfec', 'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:53:39 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:53:39 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAUnBGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:39 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23730393036376533', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730393036376533', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.629s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be30c7-fb27-44bb-9954-e9f2bdea45a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:40 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lazy-loading 'pci_devices' on Instance uuid b4bad65f-909e-4a75-a4d0-bf81f89dcc84 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a73ad9-f81b-4bc3-87ec-c6c374c2c403]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e] added
Aug 09 00:53:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:53:40 user nova-compute[72780]:   <uuid>b4bad65f-909e-4a75-a4d0-bf81f89dcc84</uuid>
Aug 09 00:53:40 user nova-compute[72780]:   <name>instance-0000000a</name>
Aug 09 00:53:40 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:53:40 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:53:40 user nova-compute[72780]:   <metadata>
Aug 09 00:53:40 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:53:40 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:53:40 user nova-compute[72780]:       <nova:name>tempest-device-tagging-server-1765148162</nova:name>
Aug 09 00:53:40 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:53:35</nova:creationTime>
Aug 09 00:53:40 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:53:40 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:53:40 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:53:40 user nova-compute[72780]:       <nova:owner>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:user uuid="bcb53e6952f94e518a3b2f877c861e5f">tempest-TaggedBootDevicesTest-1856963703-project-member</nova:user>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:project uuid="030c483139e24282b62330ed55a89250">tempest-TaggedBootDevicesTest-1856963703</nova:project>
Aug 09 00:53:40 user nova-compute[72780]:       </nova:owner>
Aug 09 00:53:40 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:53:40 user nova-compute[72780]:       <nova:ports>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="0134357c-554f-4988-a2d8-54ecd8ab6fc3">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="01821a48-8082-4e27-92f9-2dda759697a9">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="c78b4641-74a7-4ce9-b168-a3a2fb45f570">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="dcb49fde-0076-4f71-907e-b1665a019e11">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="72301431-d6e6-4267-93f0-6970ab95454f">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="79394c84-f680-4f00-9318-31684ee93095">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:         <nova:port uuid="f64598f8-c8f2-453b-bedd-4606158a87f2">
Aug 09 00:53:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 00:53:40 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:40 user nova-compute[72780]:       </nova:ports>
Aug 09 00:53:40 user nova-compute[72780]:     </nova:instance>
Aug 09 00:53:40 user nova-compute[72780]:   </metadata>
Aug 09 00:53:40 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:53:40 user nova-compute[72780]:     <system>
Aug 09 00:53:40 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:53:40 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:53:40 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:53:40 user nova-compute[72780]:       <entry name="serial">b4bad65f-909e-4a75-a4d0-bf81f89dcc84</entry>
Aug 09 00:53:40 user nova-compute[72780]:       <entry name="uuid">b4bad65f-909e-4a75-a4d0-bf81f89dcc84</entry>
Aug 09 00:53:40 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:53:40 user nova-compute[72780]:     </system>
Aug 09 00:53:40 user nova-compute[72780]:   </sysinfo>
Aug 09 00:53:40 user nova-compute[72780]:   <os>
Aug 09 00:53:40 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:53:40 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:53:40 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:53:40 user nova-compute[72780]:   </os>
Aug 09 00:53:40 user nova-compute[72780]:   <features>
Aug 09 00:53:40 user nova-compute[72780]:     <acpi/>
Aug 09 00:53:40 user nova-compute[72780]:     <apic/>
Aug 09 00:53:40 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:53:40 user nova-compute[72780]:   </features>
Aug 09 00:53:40 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:53:40 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:53:40 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:53:40 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:53:40 user nova-compute[72780]:   </clock>
Aug 09 00:53:40 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:53:40 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:53:40 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:53:40 user nova-compute[72780]:   </cpu>
Aug 09 00:53:40 user nova-compute[72780]:   <devices>
Aug 09 00:53:40 user nova-compute[72780]:     <disk type="file" device="cdrom">
Aug 09 00:53:40 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 00:53:40 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84/disk.config"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="hda" bus="ide"/>
Aug 09 00:53:40 user nova-compute[72780]:     </disk>
Aug 09 00:53:40 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:53:40 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:40 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <serial>23ccf7fd-5226-44c2-98b5-f8f96d10bb23</serial>
Aug 09 00:53:40 user nova-compute[72780]:     </disk>
Aug 09 00:53:40 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:53:40 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:40 user nova-compute[72780]:       <source dev="/dev/sdc"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <serial>48ea1630-08b6-4e9a-9915-a23f15105d34</serial>
Aug 09 00:53:40 user nova-compute[72780]:     </disk>
Aug 09 00:53:40 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:53:40 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:40 user nova-compute[72780]:       <source dev="/dev/sdd"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="vdc" bus="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <serial>112126a1-e6da-4856-828f-0020706660f2</serial>
Aug 09 00:53:40 user nova-compute[72780]:     </disk>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:03:c0:20"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tap0134357c-55"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:06:34:3d"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tap01821a48-80"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:97:92:7a"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tapc78b4641-74"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:39:99:d4"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tapdcb49fde-00"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:56:35:6b"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tap72301431-d6"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:c3:a6:06"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tap79394c84-f6"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:40 user nova-compute[72780]:       <mac address="fa:16:3e:b0:57:b8"/>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:40 user nova-compute[72780]:       <target dev="tapf64598f8-c8"/>
Aug 09 00:53:40 user nova-compute[72780]:     </interface>
Aug 09 00:53:40 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:53:40 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84/console.log" append="off"/>
Aug 09 00:53:40 user nova-compute[72780]:     </serial>
Aug 09 00:53:40 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:53:40 user nova-compute[72780]:     <video>
Aug 09 00:53:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:40 user nova-compute[72780]:     </video>
Aug 09 00:53:40 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:53:40 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:53:40 user nova-compute[72780]:     </rng>
Aug 09 00:53:40 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:53:40 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:53:40 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:53:40 user nova-compute[72780]:     </memballoon>
Aug 09 00:53:40 user nova-compute[72780]:   </devices>
Aug 09 00:53:40 user nova-compute[72780]: </domain>
Aug 09 00:53:40 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0134357c-55, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0134357c-55, col_values=(('external_ids', {'iface-id': '0134357c-554f-4988-a2d8-54ecd8ab6fc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:c0:20', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d22fa-0fc2-4b6b-bb33-b4739b75d964]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01821a48-80, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01821a48-80, col_values=(('external_ids', {'iface-id': '01821a48-8082-4e27-92f9-2dda759697a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:34:3d', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955410d-f8a1-4bcb-8781-21fd3b6cc305]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJAUnBGL {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJAUnBGL" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4370f19-115f-4138-9c30-387a855b56ea]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iJAUnBGL'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc78b4641-74, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc78b4641-74, col_values=(('external_ids', {'iface-id': 'c78b4641-74a7-4ce9-b168-a3a2fb45f570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:92:7a', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3fc6f8-8931-4e1e-aef0-1f59463c12dd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcb49fde-00, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdcb49fde-00, col_values=(('external_ids', {'iface-id': 'dcb49fde-0076-4f71-907e-b1665a019e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:99:d4', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283b53a-a553-4fd0-87c5-66fd50f8c67b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72301431-d6, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72301431-d6, col_values=(('external_ids', {'iface-id': '72301431-d6e6-4267-93f0-6970ab95454f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:35:6b', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea490dd-ed51-4738-93ac-c9116ee9691c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260]
Aug 09 00:53:40 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb69093-ef67-4366-88eb-d9cd52c330ca]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79394c84-f6, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79394c84-f6, col_values=(('external_ids', {'iface-id': '79394c84-f680-4f00-9318-31684ee93095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:a6:06', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed76931-bef1-41e4-80ec-d81696584254]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01dad80-f85c-4bdb-9e36-a43e084e3b07]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAUnBGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf64598f8-c8, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf64598f8-c8, col_values=(('external_ids', {'iface-id': 'f64598f8-c8f2-453b-bedd-4606158a87f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:57:b8', 'vm-uuid': 'b4bad65f-909e-4a75-a4d0-bf81f89dcc84'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:40 user nova-compute[72780]: INFO os_vif [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8')
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] No BDM found with device name hda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] No VIF found with MAC fa:16:3e:03:c0:20, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] No VIF found with MAC fa:16:3e:56:35:6b, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Using config drive
Aug 09 00:53:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Creating config drive at /opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84/disk.config
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2i6prody {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2i6prody" returned: 0 in 0.053s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== connect_volume: return (2029ms) {'type': 'block', 'scsi_wwn': '23935333831623439', 'path': '/dev/sde'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935333831623439', 'path': '/dev/sde'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYqgdpVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:41 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:41 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:41 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b26aeaa-5dde-40b1-a8ba-d7ea31477567]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:41 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca4bdb-07e8-47f5-8a3b-8582343d6bc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190] added
Aug 09 00:53:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[292dd1a3-6d3f-47b8-bf9d-73cb52680475]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[996648a5-dcc6-4c5f-9a1c-cf927c290fea]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYqgdpVH {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYqgdpVH" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[872fd512-560c-4448-8eee-1ec79e0ed57b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYqgdpVH'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ce73e-820f-44b5-a780-5454d569131c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455d79f-1f68-450b-8f2c-d61e6e43031b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c07a448-b5a3-4d08-b4da-c8794205851b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260]
Aug 09 00:53:41 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d0060-d8b2-4dfe-98de-3cbebba62db5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[086f1711-5e36-4f52-b914-62b18a28a752]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:41 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1343eafe-3817-4e56-9b86-c789a769e3ce]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYqgdpVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-60b3e6a7-2545-43d3-9762-52beeac7a2f6 req-f84e4463-e93c-4a3f-b5b5-43ad659f7a79 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-60b3e6a7-2545-43d3-9762-52beeac7a2f6 req-f84e4463-e93c-4a3f-b5b5-43ad659f7a79 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-60b3e6a7-2545-43d3-9762-52beeac7a2f6 req-f84e4463-e93c-4a3f-b5b5-43ad659f7a79 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-60b3e6a7-2545-43d3-9762-52beeac7a2f6 req-f84e4463-e93c-4a3f-b5b5-43ad659f7a79 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-60b3e6a7-2545-43d3-9762-52beeac7a2f6 req-f84e4463-e93c-4a3f-b5b5-43ad659f7a79 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:42 user nova-compute[72780]: WARNING nova.compute.manager [req-60b3e6a7-2545-43d3-9762-52beeac7a2f6 req-f84e4463-e93c-4a3f-b5b5-43ad659f7a79 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 for instance with vm_state building and task_state spawning.
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26261353931333863', 'path': '/dev/sdf'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261353931333863', 'path': '/dev/sdf'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjfnLpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:43 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:43 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:43 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[de61c9b1-cea9-4b9e-80f1-474a84ddfb58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:43 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e864a5-ff0b-4497-b555-290f958f2018]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab] added
Aug 09 00:53:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1623f23-119c-4bb1-a7ef-b6008934488c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb90a7e3-1491-46ee-84d3-26d714f569cd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjfnLpWQ {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjfnLpWQ" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0360e-9e8c-4502-8c0b-84870f9a720d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjfnLpWQ'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ebf4ee-0cb3-49bb-aadc-898dee065f17]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[742537c1-79ef-42fb-a451-e7e86d6e7f15]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d550f1e-0cd6-4dbf-9f93-7d4a7a83ad00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260]
Aug 09 00:53:43 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0def38-2503-4fb5-8c39-e53f1001d09e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[41213168-adbf-4d82-9b8c-d96a34ee1a71]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:43 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4770d41f-fa99-4e8f-bd04-f707466244c1]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjfnLpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bad51b5-710b-44c5-b74e-179a015723a6 req-e365135f-f234-440e-bc84-00e8b7bada3e service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bad51b5-710b-44c5-b74e-179a015723a6 req-e365135f-f234-440e-bc84-00e8b7bada3e service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bad51b5-710b-44c5-b74e-179a015723a6 req-e365135f-f234-440e-bc84-00e8b7bada3e service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bad51b5-710b-44c5-b74e-179a015723a6 req-e365135f-f234-440e-bc84-00e8b7bada3e service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bad51b5-710b-44c5-b74e-179a015723a6 req-e365135f-f234-440e-bc84-00e8b7bada3e service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:43 user nova-compute[72780]: WARNING nova.compute.manager [req-3bad51b5-710b-44c5-b74e-179a015723a6 req-e365135f-f234-440e-bc84-00e8b7bada3e service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 for instance with vm_state building and task_state spawning.
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d3091b1-6155-483b-8248-31ad31b77d0f req-e6bf66a2-d956-4057-95a2-3f9841cab159 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d3091b1-6155-483b-8248-31ad31b77d0f req-e6bf66a2-d956-4057-95a2-3f9841cab159 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d3091b1-6155-483b-8248-31ad31b77d0f req-e6bf66a2-d956-4057-95a2-3f9841cab159 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d3091b1-6155-483b-8248-31ad31b77d0f req-e6bf66a2-d956-4057-95a2-3f9841cab159 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d3091b1-6155-483b-8248-31ad31b77d0f req-e6bf66a2-d956-4057-95a2-3f9841cab159 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:44 user nova-compute[72780]: WARNING nova.compute.manager [req-6d3091b1-6155-483b-8248-31ad31b77d0f req-e6bf66a2-d956-4057-95a2-3f9841cab159 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 for instance with vm_state building and task_state spawning.
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23162656161343737', 'path': '/dev/sdg'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162656161343737', 'path': '/dev/sdg'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.objects.instance [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e0fc6f8-5e07-421e-a841-de1c73a7b41e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542409.5640454, cac5ef5b-ca76-4c2a-89b3-7aefea704ee4 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:53:44 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] VM Stopped (Lifecycle Event)
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:53:44 user nova-compute[72780]:   <uuid>0e0fc6f8-5e07-421e-a841-de1c73a7b41e</uuid>
Aug 09 00:53:44 user nova-compute[72780]:   <name>instance-00000009</name>
Aug 09 00:53:44 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:53:44 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:53:44 user nova-compute[72780]:   <metadata>
Aug 09 00:53:44 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:53:44 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:53:44 user nova-compute[72780]:       <nova:name>tempest-device-tagging-server-900174190</nova:name>
Aug 09 00:53:44 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:53:39</nova:creationTime>
Aug 09 00:53:44 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:53:44 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:53:44 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:53:44 user nova-compute[72780]:       <nova:owner>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:user uuid="c57ad9eb9fd945a6916cc31ad2557c0f">tempest-TaggedBootDevicesTest_v242-1269375644-project-member</nova:user>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:project uuid="9858a38f25aa4dd3bbfd1a80ef16b5de">tempest-TaggedBootDevicesTest_v242-1269375644</nova:project>
Aug 09 00:53:44 user nova-compute[72780]:       </nova:owner>
Aug 09 00:53:44 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:53:44 user nova-compute[72780]:       <nova:ports>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="c6cbace6-13de-46ce-a8a1-1992c6f8f091">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="5951788c-c1ce-4412-9d1b-2881f3efcf6d">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="268dcf01-4949-4ea7-9325-985babb69a79">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="e7947d80-596a-45d5-b72b-b74cbd725e55">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.42" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="740e63a0-2dcf-482e-9013-c25eda8ba97c">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="f38f18af-55a5-47fc-8be0-4924d404eb2e">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:         <nova:port uuid="5c1db11d-23e2-4fce-a4e6-61364225ee37">
Aug 09 00:53:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 00:53:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:53:44 user nova-compute[72780]:       </nova:ports>
Aug 09 00:53:44 user nova-compute[72780]:     </nova:instance>
Aug 09 00:53:44 user nova-compute[72780]:   </metadata>
Aug 09 00:53:44 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:53:44 user nova-compute[72780]:     <system>
Aug 09 00:53:44 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:53:44 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:53:44 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:53:44 user nova-compute[72780]:       <entry name="serial">0e0fc6f8-5e07-421e-a841-de1c73a7b41e</entry>
Aug 09 00:53:44 user nova-compute[72780]:       <entry name="uuid">0e0fc6f8-5e07-421e-a841-de1c73a7b41e</entry>
Aug 09 00:53:44 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:53:44 user nova-compute[72780]:     </system>
Aug 09 00:53:44 user nova-compute[72780]:   </sysinfo>
Aug 09 00:53:44 user nova-compute[72780]:   <os>
Aug 09 00:53:44 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:53:44 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:53:44 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:53:44 user nova-compute[72780]:   </os>
Aug 09 00:53:44 user nova-compute[72780]:   <features>
Aug 09 00:53:44 user nova-compute[72780]:     <acpi/>
Aug 09 00:53:44 user nova-compute[72780]:     <apic/>
Aug 09 00:53:44 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:53:44 user nova-compute[72780]:   </features>
Aug 09 00:53:44 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:53:44 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:53:44 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:53:44 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:53:44 user nova-compute[72780]:   </clock>
Aug 09 00:53:44 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:53:44 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:53:44 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:53:44 user nova-compute[72780]:   </cpu>
Aug 09 00:53:44 user nova-compute[72780]:   <devices>
Aug 09 00:53:44 user nova-compute[72780]:     <disk type="file" device="cdrom">
Aug 09 00:53:44 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 00:53:44 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e/disk.config"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="hda" bus="ide"/>
Aug 09 00:53:44 user nova-compute[72780]:     </disk>
Aug 09 00:53:44 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:53:44 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:44 user nova-compute[72780]:       <source dev="/dev/sde"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <serial>663bf838-36a9-4e8f-bcd1-f24f5223120e</serial>
Aug 09 00:53:44 user nova-compute[72780]:     </disk>
Aug 09 00:53:44 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:53:44 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:44 user nova-compute[72780]:       <source dev="/dev/sdf"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <serial>6c18dd1e-b645-4e22-81be-f90ed02a1190</serial>
Aug 09 00:53:44 user nova-compute[72780]:     </disk>
Aug 09 00:53:44 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:53:44 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:44 user nova-compute[72780]:       <source dev="/dev/sdg"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="vdc" bus="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <serial>5aafb0a0-3c45-47c1-8c19-8233ce92f6ab</serial>
Aug 09 00:53:44 user nova-compute[72780]:     </disk>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:a1:d8:24"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tapc6cbace6-13"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:6a:86:a7"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tap5951788c-c1"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:d4:f7:0b"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tap268dcf01-49"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:0a:d9:49"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tape7947d80-59"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:ea:90:cc"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tap740e63a0-2d"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:f5:35:e9"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tapf38f18af-55"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:53:44 user nova-compute[72780]:       <mac address="fa:16:3e:af:6a:9a"/>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:53:44 user nova-compute[72780]:       <target dev="tap5c1db11d-23"/>
Aug 09 00:53:44 user nova-compute[72780]:     </interface>
Aug 09 00:53:44 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:53:44 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e/console.log" append="off"/>
Aug 09 00:53:44 user nova-compute[72780]:     </serial>
Aug 09 00:53:44 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:53:44 user nova-compute[72780]:     <video>
Aug 09 00:53:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:53:44 user nova-compute[72780]:     </video>
Aug 09 00:53:44 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:53:44 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:53:44 user nova-compute[72780]:     </rng>
Aug 09 00:53:44 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:53:44 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:53:44 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:53:44 user nova-compute[72780]:     </memballoon>
Aug 09 00:53:44 user nova-compute[72780]:   </devices>
Aug 09 00:53:44 user nova-compute[72780]: </domain>
Aug 09 00:53:44 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6148942e-52fc-47b2-b140-0f9fb39e2b0c None None] [instance: cac5ef5b-ca76-4c2a-89b3-7aefea704ee4] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6cbace6-13, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6cbace6-13, col_values=(('external_ids', {'iface-id': 'c6cbace6-13de-46ce-a8a1-1992c6f8f091', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:d8:24', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13')
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5951788c-c1, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5951788c-c1, col_values=(('external_ids', {'iface-id': '5951788c-c1ce-4412-9d1b-2881f3efcf6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:86:a7', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1')
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap268dcf01-49, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap268dcf01-49, col_values=(('external_ids', {'iface-id': '268dcf01-4949-4ea7-9325-985babb69a79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:f7:0b', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49')
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7947d80-59, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7947d80-59, col_values=(('external_ids', {'iface-id': 'e7947d80-596a-45d5-b72b-b74cbd725e55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:d9:49', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:44 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:44 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:44 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3adf94e-9466-455f-8e00-ee9c5a1846e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:44 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e188651-a348-48e1-a4c4-e172d9183108]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e] added
Aug 09 00:53:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59')
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap740e63a0-2d, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap740e63a0-2d, col_values=(('external_ids', {'iface-id': '740e63a0-2dcf-482e-9013-c25eda8ba97c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:90:cc', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:45 user nova-compute[72780]: WARNING nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 for instance with vm_state building and task_state spawning.
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:45 user nova-compute[72780]: WARNING nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 for instance with vm_state building and task_state spawning.
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:45 user nova-compute[72780]: WARNING nova.compute.manager [req-af4bf5a6-798e-45aa-b3ff-6cc6ee35f044 req-3f70c0e9-778b-4087-95be-dea11835a4d1 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 for instance with vm_state building and task_state spawning.
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8087e0bd-69c6-4459-a76a-ff49172bb0e6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc21a4-c681-4ebe-ad78-906e40b80128]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHrnjJko {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d')
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHrnjJko" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba63829-9cf4-49ae-8b5c-6faeaffd8c4a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uHrnjJko'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf38f18af-55, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf38f18af-55, col_values=(('external_ids', {'iface-id': 'f38f18af-55a5-47fc-8be0-4924d404eb2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:35:e9', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc184e7-8f2b-4f4c-8c55-a884c3b85949]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0313c2-bf87-4e65-a82c-ec62819f24d7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55')
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c1db11d-23, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c1db11d-23, col_values=(('external_ids', {'iface-id': '5c1db11d-23e2-4fce-a4e6-61364225ee37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:6a:9a', 'vm-uuid': '0e0fc6f8-5e07-421e-a841-de1c73a7b41e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8060b58e-e6a7-4747-88b8-7dfbce4d30e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]
Aug 09 00:53:45 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: INFO os_vif [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23')
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaf3682-348f-4eb6-b7aa-d583a4224a59]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeda0df-3a29-4d48-b67b-ad85d083f667]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:53:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:45 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:53:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[99009990-585a-4b68-9d24-c4c447ff9e8a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] No BDM found with device name hda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] No VIF found with MAC fa:16:3e:a1:d8:24, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] No VIF found with MAC fa:16:3e:ea:90:cc, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:45 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Using config drive
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-1ed336ab-7384-462d-b0d2-b0aee55a7617 req-458e0127-5846-4d9f-9acb-d37ea62b06a3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1ed336ab-7384-462d-b0d2-b0aee55a7617 req-458e0127-5846-4d9f-9acb-d37ea62b06a3 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1ed336ab-7384-462d-b0d2-b0aee55a7617 req-458e0127-5846-4d9f-9acb-d37ea62b06a3 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1ed336ab-7384-462d-b0d2-b0aee55a7617 req-458e0127-5846-4d9f-9acb-d37ea62b06a3 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-1ed336ab-7384-462d-b0d2-b0aee55a7617 req-458e0127-5846-4d9f-9acb-d37ea62b06a3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:45 user nova-compute[72780]: WARNING nova.compute.manager [req-1ed336ab-7384-462d-b0d2-b0aee55a7617 req-458e0127-5846-4d9f-9acb-d37ea62b06a3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 for instance with vm_state building and task_state spawning.
Aug 09 00:53:46 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Creating config drive at /opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e/disk.config
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqltyqf8m {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqltyqf8m" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-changed-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Refreshing instance network info cache due to event network-changed-cdcb5023-00c6-4098-9205-e770c82ffdea. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Acquiring lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Acquired lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.network.neutron [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Refreshing network info cache for port cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23365623634666238', 'path': '/dev/sdh'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365623634666238', 'path': '/dev/sdh'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:53:46 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:53:46 user nova-compute[72780]:   <source dev="/dev/sdh"/>
Aug 09 00:53:46 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:53:46 user nova-compute[72780]:   <serial>40ddfc57-e117-427e-8bbd-8afded01812e</serial>
Aug 09 00:53:46 user nova-compute[72780]: </disk>
Aug 09 00:53:46 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lazy-loading 'flavor' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:46 user nova-compute[72780]: INFO nova.compute.manager [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Attaching volume dd77fbdb-1098-45ed-ab67-335862f4df75 to /dev/vdb
Aug 09 00:53:47 user nova-compute[72780]: DEBUG os_brick.utils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06d830-531e-45a7-8186-19f244444479]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No VIF found with MAC fa:16:3e:cb:2c:84, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb59c59d-d591-4280-954f-eb891aef6444]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a1756f-e676-48f0-9cf1-661aec866603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f239477f-ec60-4040-ad17-6a8ddd1bf161]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-d6422d3d-5dfa-4f03-8902-02c01b1d8cb7 req-4657c957-1de0-4c0d-8597-1072c4f70823 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[98688494-d4e7-433a-935b-f4205a94f964]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG os_brick.utils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updating existing volume attachment record: f644f489-c81d-4cd0-b59d-19a15b23c8a6 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b7702d77-4e0b-443d-8f0d-76f23ec023e4 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.556s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updated VIF entry in instance network info cache for port cdcb5023-00c6-4098-9205-e770c82ffdea. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updating instance_info_cache with network_info: [{"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Releasing lock "refresh_cache-3d08d366-e309-4fb6-a784-6e160822b587" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:47 user nova-compute[72780]: WARNING nova.compute.manager [req-03945d1a-009b-40aa-8f75-22ac3b25ec51 req-339c840c-ba72-4c2a-9466-552bd197ce5b service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f for instance with vm_state building and task_state spawning.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542427.7891667, b4bad65f-909e-4a75-a4d0-bf81f89dcc84 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:53:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] VM Resumed (Lifecycle Event)
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:53:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance spawned successfully.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542427.7911818, b4bad65f-909e-4a75-a4d0-bf81f89dcc84 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:53:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] VM Started (Lifecycle Event)
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:53:47 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:53:47 user nova-compute[72780]: INFO nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Took 11.99 seconds to spawn the instance on the hypervisor.
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-changed-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Refreshing instance network info cache due to event network-changed-2e61c469-6072-4b94-be42-5333daa7700b. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] Acquiring lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] Acquired lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Refreshing network info cache for port 2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:48 user nova-compute[72780]: INFO nova.compute.manager [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Took 44.46 seconds to build instance.
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9763d6d0-5745-402b-8f99-551b0c27430e tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.588s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "interface-78fd796d-5fbe-4352-9df8-7d718bc8bde2-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "interface-78fd796d-5fbe-4352-9df8-7d718bc8bde2-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'flavor' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72780) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'pci_requests' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.network.neutron [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updated VIF entry in instance network info cache for port 2e61c469-6072-4b94-be42-5333daa7700b. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updating instance_info_cache with network_info: [{"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] Releasing lock "refresh_cache-2550fbbd-c0ed-405a-b756-d834138028ad" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-changed-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Refreshing instance network info cache due to event network-changed-d4522d9f-6eba-45f7-b5df-82d8d36410bc. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] Acquiring lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] Acquired lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Refreshing network info cache for port d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:48 user nova-compute[72780]: DEBUG nova.policy [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f1daff87854ba49adc00cd53ae85f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a75d1aa47c4c2580cf976ecc9be560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-3f7c382f-78ce-4bd5-bba4-685746294e9d req-a252e2cd-bfe8-4e3b-872c-980d2cea1960 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3f7c382f-78ce-4bd5-bba4-685746294e9d req-a252e2cd-bfe8-4e3b-872c-980d2cea1960 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3f7c382f-78ce-4bd5-bba4-685746294e9d req-a252e2cd-bfe8-4e3b-872c-980d2cea1960 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3f7c382f-78ce-4bd5-bba4-685746294e9d req-a252e2cd-bfe8-4e3b-872c-980d2cea1960 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-3f7c382f-78ce-4bd5-bba4-685746294e9d req-a252e2cd-bfe8-4e3b-872c-980d2cea1960 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:49 user nova-compute[72780]: WARNING nova.compute.manager [req-3f7c382f-78ce-4bd5-bba4-685746294e9d req-a252e2cd-bfe8-4e3b-872c-980d2cea1960 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d for instance with vm_state building and task_state spawning.
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-db7e099f-93b5-460d-aa16-af6069593935 req-02eef924-214e-4e7b-b998-d03ff9846d1b service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-db7e099f-93b5-460d-aa16-af6069593935 req-02eef924-214e-4e7b-b998-d03ff9846d1b service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-db7e099f-93b5-460d-aa16-af6069593935 req-02eef924-214e-4e7b-b998-d03ff9846d1b service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-db7e099f-93b5-460d-aa16-af6069593935 req-02eef924-214e-4e7b-b998-d03ff9846d1b service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-db7e099f-93b5-460d-aa16-af6069593935 req-02eef924-214e-4e7b-b998-d03ff9846d1b service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:49 user nova-compute[72780]: WARNING nova.compute.manager [req-db7e099f-93b5-460d-aa16-af6069593935 req-02eef924-214e-4e7b-b998-d03ff9846d1b service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 for instance with vm_state building and task_state spawning.
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance destroyed successfully.
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Successfully created port: c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff824569-0368-4a6e-a20d-6bf2cb6edb7c tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.548s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.network.neutron [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updated VIF entry in instance network info cache for port d4522d9f-6eba-45f7-b5df-82d8d36410bc. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG nova.network.neutron [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c194d43-391c-4239-846f-6044f2735886 req-c1ad3c44-8672-4d41-bc50-79b9e8710fb7 service nova] Releasing lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:50 user nova-compute[72780]: WARNING nova.compute.manager [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state None.
Aug 09 00:53:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:50 user nova-compute[72780]: WARNING nova.compute.manager [req-6ca49eed-1c4d-4873-92fd-c828983daff4 req-be035591-8b7e-41e0-a9c7-84378042d0c3 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state None.
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-dde2b3c7-9327-4185-ac7b-3d804fdd8f1d req-f3279758-f582-42de-9703-fbe16d6556f2 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:51 user nova-compute[72780]: WARNING nova.compute.manager [req-f783b5f2-c8e3-4e09-b1ed-5a1f38f5e56d req-e5922fe0-2bc6-47a6-895f-747303ae6a85 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 for instance with vm_state building and task_state spawning.
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Successfully updated port: c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquired lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:52 user nova-compute[72780]: WARNING nova.compute.manager [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 for instance with vm_state building and task_state spawning.
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:52 user nova-compute[72780]: WARNING nova.compute.manager [req-f5f91c31-5cc7-42c6-bffb-f946d23698b4 req-6d881b01-e636-4f7d-9f4c-16281b241e58 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 for instance with vm_state building and task_state spawning.
Aug 09 00:53:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.network.neutron [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Releasing lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:52 user nova-compute[72780]: DEBUG os_vif [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5bca965-e1, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5bca965-e1, col_values=(('external_ids', {'iface-id': 'c5bca965-e170-4505-b56d-4b871b7d9733', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:37:42', 'vm-uuid': '78fd796d-5fbe-4352-9df8-7d718bc8bde2'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: INFO os_vif [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1')
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] attach device xml: <interface type="ethernet">
Aug 09 00:53:53 user nova-compute[72780]:   <mac address="fa:16:3e:03:37:42"/>
Aug 09 00:53:53 user nova-compute[72780]:   <model type="virtio"/>
Aug 09 00:53:53 user nova-compute[72780]:   <mtu size="1442"/>
Aug 09 00:53:53 user nova-compute[72780]:   <target dev="tapc5bca965-e1"/>
Aug 09 00:53:53 user nova-compute[72780]: </interface>
Aug 09 00:53:53 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:53 user nova-compute[72780]: WARNING nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 for instance with vm_state building and task_state spawning.
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:53 user nova-compute[72780]: WARNING nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e for instance with vm_state building and task_state spawning.
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-changed-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Refreshing instance network info cache due to event network-changed-c5bca965-e170-4505-b56d-4b871b7d9733. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Acquiring lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Acquired lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.network.neutron [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Refreshing network info cache for port c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-f90a8f48-0d3c-4815-976a-815119a0e9ce req-1bd72c9d-4dda-40db-9846-2e6e3e28d305 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f90a8f48-0d3c-4815-976a-815119a0e9ce req-1bd72c9d-4dda-40db-9846-2e6e3e28d305 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f90a8f48-0d3c-4815-976a-815119a0e9ce req-1bd72c9d-4dda-40db-9846-2e6e3e28d305 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f90a8f48-0d3c-4815-976a-815119a0e9ce req-1bd72c9d-4dda-40db-9846-2e6e3e28d305 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-f90a8f48-0d3c-4815-976a-815119a0e9ce req-1bd72c9d-4dda-40db-9846-2e6e3e28d305 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:53 user nova-compute[72780]: WARNING nova.compute.manager [req-f90a8f48-0d3c-4815-976a-815119a0e9ce req-1bd72c9d-4dda-40db-9846-2e6e3e28d305 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 for instance with vm_state active and task_state None.
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No BDM found with device name hda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No VIF found with MAC fa:16:3e:81:35:4c, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:53:53 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:53:53 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:53:53 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:53:53</nova:creationTime>
Aug 09 00:53:53 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:53:53 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:53:53 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:53:53 user nova-compute[72780]:   <nova:owner>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:53:53 user nova-compute[72780]:   </nova:owner>
Aug 09 00:53:53 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:53:53 user nova-compute[72780]:   <nova:ports>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:53:53 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:53:53 user nova-compute[72780]:     </nova:port>
Aug 09 00:53:53 user nova-compute[72780]:     <nova:port uuid="c5bca965-e170-4505-b56d-4b871b7d9733">
Aug 09 00:53:53 user nova-compute[72780]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Aug 09 00:53:53 user nova-compute[72780]:     </nova:port>
Aug 09 00:53:53 user nova-compute[72780]:   </nova:ports>
Aug 09 00:53:53 user nova-compute[72780]: </nova:instance>
Aug 09 00:53:53 user nova-compute[72780]:  {{(pid=72780) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-162ed010-7c1f-4e6b-8521-c430ae65f918 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "interface-78fd796d-5fbe-4352-9df8-7d718bc8bde2-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.614s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542434.025307, 0e0fc6f8-5e07-421e-a841-de1c73a7b41e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] VM Resumed (Lifecycle Event)
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance spawned successfully.
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542434.0322123, 0e0fc6f8-5e07-421e-a841-de1c73a7b41e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] VM Started (Lifecycle Event)
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.objects.instance [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lazy-loading 'flavor' on Instance uuid 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Took 14.78 seconds to spawn the instance on the hypervisor.
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.network.neutron [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updated VIF entry in instance network info cache for port c5bca965-e170-4505-b56d-4b871b7d9733. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.network.neutron [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Releasing lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:54 user nova-compute[72780]: WARNING nova.compute.manager [req-6319d637-237a-49fb-952e-64448ef2082e req-df3a8730-6855-4400-9047-17c13ccf7f40 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e for instance with vm_state building and task_state spawning.
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Took 57.97 seconds to build instance.
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cfccb68a-5090-4546-b6a4-342a1f8bfcb4 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.076s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Attaching volume b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 to /dev/sdc
Aug 09 00:53:54 user nova-compute[72780]: DEBUG os_brick.utils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bdc6a0-5235-494d-ab91-280a2d46514d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76859f-6e40-420d-9c1b-fbefeea48c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e856c05e-9ec8-428a-97b3-71ca4c4e5183]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b4cc9-220d-4280-81b7-98a11465f82f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:54 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7fc28e-1583-447e-bcb7-7c53d8255985]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG os_brick.utils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updating existing volume attachment record: 4798e3fc-0329-4ccc-ae1a-24c6c59be7ce {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-changed-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Refreshing instance network info cache due to event network-changed-4bc6d8b1-c27c-4e16-98c3-53903d83a899. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] Acquiring lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] Acquired lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.network.neutron [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Refreshing network info cache for port 4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG nova.objects.instance [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'flavor' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:54 user nova-compute[72780]: INFO nova.compute.manager [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Attaching volume 2018e110-f0e1-40da-bec1-c82062dffc61 to /dev/vdb
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lazy-loading 'flavor' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG os_brick.utils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[30815885-b9cc-44ff-8228-eae8569617ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96dc534-8573-4ba3-bb3d-f4457211b92a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223caff-4ffa-436e-9d33-2574393e99f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b62892-85db-4204-86f9-c5e64beee9a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:55 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f3f93-b191-4e2f-a680-a513a4f2f5f9]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG os_brick.utils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating existing volume attachment record: 59cbb54d-936c-4691-b096-6c9424328323 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:55 user nova-compute[72780]: INFO nova.compute.manager [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Attaching volume ebd4aa80-edbd-4882-9e99-89db2a5f1205 to /dev/vdb
Aug 09 00:53:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updated VIF entry in instance network info cache for port 4bc6d8b1-c27c-4e16-98c3-53903d83a899. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updating instance_info_cache with network_info: [{"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f9dded57-71b7-4f4a-949f-0954d0f5c3bf req-29738b07-4ecf-4a93-9419-8007a5c61f86 service nova] Releasing lock "refresh_cache-04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8d908ae-3e7a-467e-a44c-8f5811a7a80f req-b2ee54cc-fd7a-4d22-829a-745d500fa9f8 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8d908ae-3e7a-467e-a44c-8f5811a7a80f req-b2ee54cc-fd7a-4d22-829a-745d500fa9f8 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8d908ae-3e7a-467e-a44c-8f5811a7a80f req-b2ee54cc-fd7a-4d22-829a-745d500fa9f8 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8d908ae-3e7a-467e-a44c-8f5811a7a80f req-b2ee54cc-fd7a-4d22-829a-745d500fa9f8 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:53:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8d908ae-3e7a-467e-a44c-8f5811a7a80f req-b2ee54cc-fd7a-4d22-829a-745d500fa9f8 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:53:55 user nova-compute[72780]: WARNING nova.compute.manager [req-e8d908ae-3e7a-467e-a44c-8f5811a7a80f req-b2ee54cc-fd7a-4d22-829a-745d500fa9f8 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 for instance with vm_state active and task_state None.
Aug 09 00:53:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaiOszcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:58 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:58 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:53:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:53:58 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:53:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6dadc1-d310-4036-9f37-74f2f7819bcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:53:58 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf0587-e246-4540-aea0-873d007b8c2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75] added
Aug 09 00:53:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ac57b-59fd-465a-af94-c528dae9b042]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9bd26-ff2b-429a-87aa-1d2e734cbe1c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaiOszcX {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaiOszcX" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[264479da-6276-4ed7-a95c-cfaab01faa7e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaiOszcX'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e5c55-a2c3-46e6-93fe-30537d99bbcc]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[64928650-6dca-4906-ac98-8f5fd233bb56]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ca194-c13f-4a38-b796-fff780f0c143]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260]
Aug 09 00:53:59 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260] successful.
Aug 09 00:53:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.utils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3627992-e7a6-46cf-8808-8af709fd432b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf3903e-1b4d-4ad5-b1e2-b922413912d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f229ae-463f-4f6c-b922-233cfdda2e1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:53:59 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:53:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04e54c-0fac-4fc7-a80b-33c1105306a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530fe2f-33f3-4b79-8b7f-4dfdde94f23f]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaiOszcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97d0b59-f80b-4a35-a60c-b1a242b0c69e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763a515-5f61-46fb-bdcd-cd5710ad31af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:53:59 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:53:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a103f-f558-4252-a96e-2429cccf5cd1]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG os_brick.utils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updating existing volume attachment record: 0a57f6f6-aa66-4ce4-ae29-3b41cee57058 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:53:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23235323237353362', 'path': '/dev/sdi'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235323237353362', 'path': '/dev/sdi'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lazy-loading 'flavor' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 00:54:00 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:00 user nova-compute[72780]:   <source dev="/dev/sdi"/>
Aug 09 00:54:00 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:00 user nova-compute[72780]:   <serial>dd77fbdb-1098-45ed-ab67-335862f4df75</serial>
Aug 09 00:54:00 user nova-compute[72780]: </disk>
Aug 09 00:54:00 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] No VIF found with MAC fa:16:3e:04:a5:a8, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:04 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542429.708986, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:04 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Stopped (Lifecycle Event)
Aug 09 00:54:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-eb2ba1bb-2569-41ed-8b29-2836045ed138 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-eb2ba1bb-2569-41ed-8b29-2836045ed138 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsuGwRxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:05 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb53d0-29a5-4f54-867c-ee2e06c2b8dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:54:05 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[355876e7-cb2d-477f-bc74-9edf5162a154]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61] added
Aug 09 00:54:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2419f-92cd-4761-9022-bd19eaf7dc8b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a7ffe7-0ed6-4a5f-b220-d9d8abeb2c7a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dsuGwRxO {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dsuGwRxO" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6748a4c3-65e9-42a2-bc3f-825bedd8e99a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dsuGwRxO'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde4327-9c22-45ac-bc21-e4319c2e17d9]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc759c41-a9c8-40b5-a3c6-f6470ec1cfec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc4ef55f-0797-4da2-a1ce-b463324e52f7 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.279s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17859cc-85b0-41b5-962b-3c001a1b789f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260]
Aug 09 00:54:06 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:06 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e9b8b-41bd-4894-8e87-9dac537f58c5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1755bfc-f542-4896-ac88-736c287d892c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:06 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:06 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ecc543-d6de-4250-adfe-77bbcb0b6dc5]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsuGwRxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26563383138363532', 'path': '/dev/sdj'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563383138363532', 'path': '/dev/sdj'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.objects.instance [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'flavor' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:54:07 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:07 user nova-compute[72780]:   <source dev="/dev/sdj"/>
Aug 09 00:54:07 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:07 user nova-compute[72780]:   <serial>2018e110-f0e1-40da-bec1-c82062dffc61</serial>
Aug 09 00:54:07 user nova-compute[72780]: </disk>
Aug 09 00:54:07 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] volume_snapshot_create: create_info: {'snapshot_id': '40fb0650-3c28-47a0-80a3-6ddcb91674a9', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72780) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] snap xml: <domainsnapshot>
Aug 09 00:54:07 user nova-compute[72780]:   <disks>
Aug 09 00:54:07 user nova-compute[72780]:     <disk name="/dev/sdi" snapshot="external" type="file">
Aug 09 00:54:07 user nova-compute[72780]:       <source file="/dev/new_file"/>
Aug 09 00:54:07 user nova-compute[72780]:     </disk>
Aug 09 00:54:07 user nova-compute[72780]:     <disk name="vda" snapshot="no"/>
Aug 09 00:54:07 user nova-compute[72780]:   </disks>
Aug 09 00:54:07 user nova-compute[72780]: </domainsnapshot>
Aug 09 00:54:07 user nova-compute[72780]:  {{(pid=72780) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lazy-loading 'system_metadata' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:07 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4ec423e-8b53-4575-8f44-85f36b3e1b7a tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] volume_snapshot_delete: delete_info: {'volume_id': 'dd77fbdb-1098-45ed-ab67-335862f4df75'} {{(pid=72780) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [None req-c4ec423e-8b53-4575-8f44-85f36b3e1b7a tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     if delete_info['type'] != 'qcow2':
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] KeyError: 'type'
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     rv = execute(f, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     six.reraise(c, e, tb)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     raise value
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     rv = meth(*args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     self._volume_snapshot_create(context, instance, guest,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     rv = execute(f, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     six.reraise(c, e, tb)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     raise value
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     rv = meth(*args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] 
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No BDM found with device name hda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] No VIF found with MAC fa:16:3e:81:35:4c, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [None req-c4ec423e-8b53-4575-8f44-85f36b3e1b7a tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5681d8ce-2a0c-4af6-ab9f-47d985afca85)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 40fb0650-3c28-47a0-80a3-6ddcb91674a9 could not be found.
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 40fb0650-3c28-47a0-80a3-6ddcb91674a9 could not be found. (HTTP 404) (Request-ID: req-c45602db-3002-4003-8fdc-413a7735c5dd)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 40fb0650-3c28-47a0-80a3-6ddcb91674a9 could not be found.
Aug 09 00:54:07 user nova-compute[72780]: ERROR nova.virt.libvirt.driver 
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server [None req-c4ec423e-8b53-4575-8f44-85f36b3e1b7a tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 00:54:07 user nova-compute[72780]: ERROR oslo_messaging.rpc.server 
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server [None req-0942b291-0f8e-4384-b2d2-a6e451ecbaf4 tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 00:54:08 user nova-compute[72780]: ERROR oslo_messaging.rpc.server 
Aug 09 00:54:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f75f9731-7676-40eb-b94f-16facddc0418 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.104s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:08 user nova-compute[72780]: INFO nova.compute.manager [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Detaching volume dd77fbdb-1098-45ed-ab67-335862f4df75
Aug 09 00:54:08 user nova-compute[72780]: INFO nova.virt.block_device [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Attempting to driver detach volume dd77fbdb-1098-45ed-ab67-335862f4df75 from mountpoint /dev/vdb
Aug 09 00:54:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Attempting to detach device vdb from instance 2550fbbd-c0ed-405a-b756-d834138028ad from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:54:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:08 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:08 user nova-compute[72780]:   <source dev="/dev/sdi"/>
Aug 09 00:54:08 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:08 user nova-compute[72780]:   <serial>dd77fbdb-1098-45ed-ab67-335862f4df75</serial>
Aug 09 00:54:08 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:54:08 user nova-compute[72780]: </disk>
Aug 09 00:54:08 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:08 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Successfully detached device vdb from instance 2550fbbd-c0ed-405a-b756-d834138028ad from the persistent domain config.
Aug 09 00:54:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2550fbbd-c0ed-405a-b756-d834138028ad from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:54:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:08 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:08 user nova-compute[72780]:   <source dev="/dev/sdi"/>
Aug 09 00:54:08 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:08 user nova-compute[72780]:   <serial>dd77fbdb-1098-45ed-ab67-335862f4df75</serial>
Aug 09 00:54:08 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:54:08 user nova-compute[72780]: </disk>
Aug 09 00:54:08 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542449.047711, 2550fbbd-c0ed-405a-b756-d834138028ad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:54:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Successfully detached device vdb from instance 2550fbbd-c0ed-405a-b756-d834138028ad from the live domain config.
Aug 09 00:54:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaiOszcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:09 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2858950e-1895-451e-a59f-00dfb0ddf3c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8265631-6816-460c-8fc1-e1b1188cb256]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:09 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:09 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:09 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ae0de77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75'): ({'sdi'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Removing single pathed devices sdi {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f382f4-b08c-4c04-8551-2b540c71316f]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df784a5a-3a21-44bd-aabf-7c327bfc44a6]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Flushing IO for device /dev/sdi {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ae56b-1e64-4129-a61a-7b9ce93dacdf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5773f806-4f66-4a49-84ec-1fd44cf10ad1]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] SCSI volumes sdi have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a650e8d-a027-43a0-9507-fa672f534e72]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[853bee1b-319f-4630-98ec-2d36178e4d65]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260]
Aug 09 00:54:09 user nova-compute[72780]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:09 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd77fbdb-1098-45ed-ab67-335862f4df75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46779eb-4ac2-4ca7-ba82-d1a39c28164e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] <== disconnect_volume: return (345ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:09 user nova-compute[72780]: INFO nova.compute.manager [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Detaching volume 2018e110-f0e1-40da-bec1-c82062dffc61
Aug 09 00:54:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.objects.instance [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lazy-loading 'flavor' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-df39ea36-a433-481a-811f-ad56f3e3d6ea tempest-VolumesAssistedSnapshotsTest-1970030615 tempest-VolumesAssistedSnapshotsTest-1970030615-project-admin] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.999s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:10 user nova-compute[72780]: INFO nova.virt.block_device [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Attempting to driver detach volume 2018e110-f0e1-40da-bec1-c82062dffc61 from mountpoint /dev/vdb
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Attempting to detach device vdb from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:10 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:10 user nova-compute[72780]:   <source dev="/dev/sdj"/>
Aug 09 00:54:10 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:10 user nova-compute[72780]:   <serial>2018e110-f0e1-40da-bec1-c82062dffc61</serial>
Aug 09 00:54:10 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 00:54:10 user nova-compute[72780]: </disk>
Aug 09 00:54:10 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully detached device vdb from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the persistent domain config.
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:10 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:10 user nova-compute[72780]:   <source dev="/dev/sdj"/>
Aug 09 00:54:10 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:10 user nova-compute[72780]:   <serial>2018e110-f0e1-40da-bec1-c82062dffc61</serial>
Aug 09 00:54:10 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 00:54:10 user nova-compute[72780]: </disk>
Aug 09 00:54:10 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updating instance_info_cache with network_info: [{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:10 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:10 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:10 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ff0711-18a4-4ab8-b9af-ac79f71fca09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:54:10 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d517a492-249d-4b43-b13d-bd4cc21ad817]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205] added
Aug 09 00:54:10 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dbba18-4303-4499-88e3-795a8d5b95ea]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e80572-a1a1-48fe-b60b-f993941cfece]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrazOvRU {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrazOvRU" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[525b60f9-2837-4b78-a785-30525aad8c28]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrazOvRU'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db8191f-0383-4d8c-8bb6-04f3436467df]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c10528-5955-466c-a854-dce3a75ee6e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:10 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:10 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:10 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542450.9914696, 78fd796d-5fbe-4352-9df8-7d718bc8bde2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:54:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:54:11 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully detached device vdb from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the live domain config.
Aug 09 00:54:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsuGwRxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:11 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1f216-03df-4270-8f93-011be411c249]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]
Aug 09 00:54:11 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fb71b1-4fc5-4635-b46d-7c8665beafa8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abdd151-6fb7-43d0-a18d-a3882e22a35e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:11 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[137aca13-6ee6-4074-be91-27a6f5eb0119]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:54:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26331353032633930', 'path': '/dev/sdi'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353032633930', 'path': '/dev/sdi'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.140s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lazy-loading 'flavor' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f94300c-f069-486a-8bb2-32bb8c25d6a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:54:12 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:12 user nova-compute[72780]:   <source dev="/dev/sdi"/>
Aug 09 00:54:12 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:12 user nova-compute[72780]:   <serial>ebd4aa80-edbd-4882-9e99-89db2a5f1205</serial>
Aug 09 00:54:12 user nova-compute[72780]: </disk>
Aug 09 00:54:12 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5cc16-bc41-458d-a237-a98944bd9fd6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:12 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac017a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61'): ({'sdj'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Removing single pathed devices sdj {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6644939-2f87-41c9-a01c-447b77f6353c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4790b584-792c-4f10-b42f-398647f33d36]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Flushing IO for device /dev/sdj {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e8e25-5f08-4ef5-bc3e-11dcfb4e440f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f6898f-8d02-428e-a0cb-b5bc01a7315b]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] SCSI volumes sdj have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7bfd97-5328-483f-a2d9-150a5291f133]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.160s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2fac9-8376-4e93-a33f-6f7d289c2d02]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260]
Aug 09 00:54:12 user nova-compute[72780]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2018e110-f0e1-40da-bec1-c82062dffc61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae7f78f-1c3f-4b0e-b626-cc2b0bfd9caf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] <== disconnect_volume: return (1614ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] No VIF found with MAC fa:16:3e:5f:87:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4002b9d1-1d3c-4e46-b247-ea0949535360 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.613s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'flavor' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8979db83-0918-4ad0-9f35-ca68565f948a tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.359s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "interface-78fd796d-5fbe-4352-9df8-7d718bc8bde2-c5bca965-e170-4505-b56d-4b871b7d9733" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "interface-78fd796d-5fbe-4352-9df8-7d718bc8bde2-c5bca965-e170-4505-b56d-4b871b7d9733" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'flavor' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface> {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface> {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 00:54:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Attempting to detach device tapc5bca965-e1 from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] detach device xml: <interface type="ethernet">
Aug 09 00:54:14 user nova-compute[72780]:   <mac address="fa:16:3e:03:37:42"/>
Aug 09 00:54:14 user nova-compute[72780]:   <model type="virtio"/>
Aug 09 00:54:14 user nova-compute[72780]:   <mtu size="1442"/>
Aug 09 00:54:14 user nova-compute[72780]:   <target dev="tapc5bca965-e1"/>
Aug 09 00:54:14 user nova-compute[72780]: </interface>
Aug 09 00:54:14 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface> {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 00:54:14 user nova-compute[72780]:   <name>instance-00000007</name>
Aug 09 00:54:14 user nova-compute[72780]:   <uuid>78fd796d-5fbe-4352-9df8-7d718bc8bde2</uuid>
Aug 09 00:54:14 user nova-compute[72780]:   <metadata>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:14 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:53:53</nova:creationTime>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:54:14 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:owner>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:owner>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:ports>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:54:14 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:14 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:port uuid="c5bca965-e170-4505-b56d-4b871b7d9733">
Aug 09 00:54:14 user nova-compute[72780]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Aug 09 00:54:14 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:ports>
Aug 09 00:54:14 user nova-compute[72780]: </nova:instance>
Aug 09 00:54:14 user nova-compute[72780]:   </metadata>
Aug 09 00:54:14 user nova-compute[72780]:   <memory unit='KiB'>524288</memory>
Aug 09 00:54:14 user nova-compute[72780]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 00:54:14 user nova-compute[72780]:   <vcpu placement='static'>1</vcpu>
Aug 09 00:54:14 user nova-compute[72780]:   <resource>
Aug 09 00:54:14 user nova-compute[72780]:     <partition>/machine</partition>
Aug 09 00:54:14 user nova-compute[72780]:   </resource>
Aug 09 00:54:14 user nova-compute[72780]:   <sysinfo type='smbios'>
Aug 09 00:54:14 user nova-compute[72780]:     <system>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='version'>0.0.0</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='serial'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='uuid'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='family'>Virtual Machine</entry>
Aug 09 00:54:14 user nova-compute[72780]:     </system>
Aug 09 00:54:14 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:14 user nova-compute[72780]:   <os>
Aug 09 00:54:14 user nova-compute[72780]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 00:54:14 user nova-compute[72780]:     <boot dev='hd'/>
Aug 09 00:54:14 user nova-compute[72780]:     <smbios mode='sysinfo'/>
Aug 09 00:54:14 user nova-compute[72780]:   </os>
Aug 09 00:54:14 user nova-compute[72780]:   <features>
Aug 09 00:54:14 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:14 user nova-compute[72780]:     <apic/>
Aug 09 00:54:14 user nova-compute[72780]:     <vmcoreinfo state='on'/>
Aug 09 00:54:14 user nova-compute[72780]:   </features>
Aug 09 00:54:14 user nova-compute[72780]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 00:54:14 user nova-compute[72780]:     <model fallback='forbid'>Nehalem</model>
Aug 09 00:54:14 user nova-compute[72780]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 00:54:14 user nova-compute[72780]:     <feature policy='require' name='vme'/>
Aug 09 00:54:14 user nova-compute[72780]:     <feature policy='require' name='x2apic'/>
Aug 09 00:54:14 user nova-compute[72780]:     <feature policy='require' name='hypervisor'/>
Aug 09 00:54:14 user nova-compute[72780]:   </cpu>
Aug 09 00:54:14 user nova-compute[72780]:   <clock offset='utc'>
Aug 09 00:54:14 user nova-compute[72780]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 00:54:14 user nova-compute[72780]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 00:54:14 user nova-compute[72780]:     <timer name='hpet' present='no'/>
Aug 09 00:54:14 user nova-compute[72780]:   </clock>
Aug 09 00:54:14 user nova-compute[72780]:   <on_poweroff>destroy</on_poweroff>
Aug 09 00:54:14 user nova-compute[72780]:   <on_reboot>restart</on_reboot>
Aug 09 00:54:14 user nova-compute[72780]:   <on_crash>destroy</on_crash>
Aug 09 00:54:14 user nova-compute[72780]:   <devices>
Aug 09 00:54:14 user nova-compute[72780]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 00:54:14 user nova-compute[72780]:     <disk type='file' device='disk'>
Aug 09 00:54:14 user nova-compute[72780]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 00:54:14 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk' index='2'/>
Aug 09 00:54:14 user nova-compute[72780]:       <backingStore type='file' index='3'>
Aug 09 00:54:14 user nova-compute[72780]:         <format type='raw'/>
Aug 09 00:54:14 user nova-compute[72780]:         <source file='/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64'/>
Aug 09 00:54:14 user nova-compute[72780]:         <backingStore/>
Aug 09 00:54:14 user nova-compute[72780]:       </backingStore>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='vda' bus='virtio'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='virtio-disk0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </disk>
Aug 09 00:54:14 user nova-compute[72780]:     <disk type='file' device='cdrom'>
Aug 09 00:54:14 user nova-compute[72780]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 00:54:14 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config' index='1'/>
Aug 09 00:54:14 user nova-compute[72780]:       <backingStore/>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='hda' bus='ide'/>
Aug 09 00:54:14 user nova-compute[72780]:       <readonly/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='ide0-0-0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </disk>
Aug 09 00:54:14 user nova-compute[72780]:     <controller type='usb' index='0' model='none'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='usb'/>
Aug 09 00:54:14 user nova-compute[72780]:     </controller>
Aug 09 00:54:14 user nova-compute[72780]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='pci.0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </controller>
Aug 09 00:54:14 user nova-compute[72780]:     <controller type='ide' index='0'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='ide'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 00:54:14 user nova-compute[72780]:     </controller>
Aug 09 00:54:14 user nova-compute[72780]:     <interface type='ethernet'>
Aug 09 00:54:14 user nova-compute[72780]:       <mac address='fa:16:3e:81:35:4c'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='tapd4522d9f-6e'/>
Aug 09 00:54:14 user nova-compute[72780]:       <model type='virtio'/>
Aug 09 00:54:14 user nova-compute[72780]:       <mtu size='1442'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='net0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </interface>
Aug 09 00:54:14 user nova-compute[72780]:     <interface type='ethernet'>
Aug 09 00:54:14 user nova-compute[72780]:       <mac address='fa:16:3e:03:37:42'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='tapc5bca965-e1'/>
Aug 09 00:54:14 user nova-compute[72780]:       <model type='virtio'/>
Aug 09 00:54:14 user nova-compute[72780]:       <mtu size='1442'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='net1'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </interface>
Aug 09 00:54:14 user nova-compute[72780]:     <serial type='pty'>
Aug 09 00:54:14 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:14 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target type='isa-serial' port='0'>
Aug 09 00:54:14 user nova-compute[72780]:         <model name='isa-serial'/>
Aug 09 00:54:14 user nova-compute[72780]:       </target>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </serial>
Aug 09 00:54:14 user nova-compute[72780]:     <console type='pty' tty='/dev/pts/6'>
Aug 09 00:54:14 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:14 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target type='serial' port='0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </console>
Aug 09 00:54:14 user nova-compute[72780]:     <input type='mouse' bus='ps2'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='input0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </input>
Aug 09 00:54:14 user nova-compute[72780]:     <input type='keyboard' bus='ps2'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='input1'/>
Aug 09 00:54:14 user nova-compute[72780]:     </input>
Aug 09 00:54:14 user nova-compute[72780]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 00:54:14 user nova-compute[72780]:       <listen type='address' address='0.0.0.0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </graphics>
Aug 09 00:54:14 user nova-compute[72780]:     <audio id='1' type='none'/>
Aug 09 00:54:14 user nova-compute[72780]:     <video>
Aug 09 00:54:14 user nova-compute[72780]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='video0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </video>
Aug 09 00:54:14 user nova-compute[72780]:     <memballoon model='virtio'>
Aug 09 00:54:14 user nova-compute[72780]:       <stats period='10'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='balloon0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:14 user nova-compute[72780]:     <rng model='virtio'>
Aug 09 00:54:14 user nova-compute[72780]:       <backend model='random'>/dev/urandom</backend>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='rng0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </rng>
Aug 09 00:54:14 user nova-compute[72780]:   </devices>
Aug 09 00:54:14 user nova-compute[72780]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 00:54:14 user nova-compute[72780]:     <label>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</label>
Aug 09 00:54:14 user nova-compute[72780]:     <imagelabel>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</imagelabel>
Aug 09 00:54:14 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:14 user nova-compute[72780]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 00:54:14 user nova-compute[72780]:     <label>+64055:+108</label>
Aug 09 00:54:14 user nova-compute[72780]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 00:54:14 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:14 user nova-compute[72780]: </domain>
Aug 09 00:54:14 user nova-compute[72780]:  {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 00:54:14 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully detached device tapc5bca965-e1 from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the persistent domain config.
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] (1/8): Attempting to detach device tapc5bca965-e1 with device alias net1 from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] detach device xml: <interface type="ethernet">
Aug 09 00:54:14 user nova-compute[72780]:   <mac address="fa:16:3e:03:37:42"/>
Aug 09 00:54:14 user nova-compute[72780]:   <model type="virtio"/>
Aug 09 00:54:14 user nova-compute[72780]:   <mtu size="1442"/>
Aug 09 00:54:14 user nova-compute[72780]:   <target dev="tapc5bca965-e1"/>
Aug 09 00:54:14 user nova-compute[72780]: </interface>
Aug 09 00:54:14 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542454.3654604, 78fd796d-5fbe-4352-9df8-7d718bc8bde2 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Start waiting for the detach event from libvirt for device tapc5bca965-e1 with device alias net1 for instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface> {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 00:54:14 user nova-compute[72780]:   <name>instance-00000007</name>
Aug 09 00:54:14 user nova-compute[72780]:   <uuid>78fd796d-5fbe-4352-9df8-7d718bc8bde2</uuid>
Aug 09 00:54:14 user nova-compute[72780]:   <metadata>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:14 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:53:53</nova:creationTime>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:54:14 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:owner>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:owner>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:ports>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:54:14 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:14 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:port uuid="c5bca965-e170-4505-b56d-4b871b7d9733">
Aug 09 00:54:14 user nova-compute[72780]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Aug 09 00:54:14 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:ports>
Aug 09 00:54:14 user nova-compute[72780]: </nova:instance>
Aug 09 00:54:14 user nova-compute[72780]:   </metadata>
Aug 09 00:54:14 user nova-compute[72780]:   <memory unit='KiB'>524288</memory>
Aug 09 00:54:14 user nova-compute[72780]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 00:54:14 user nova-compute[72780]:   <vcpu placement='static'>1</vcpu>
Aug 09 00:54:14 user nova-compute[72780]:   <resource>
Aug 09 00:54:14 user nova-compute[72780]:     <partition>/machine</partition>
Aug 09 00:54:14 user nova-compute[72780]:   </resource>
Aug 09 00:54:14 user nova-compute[72780]:   <sysinfo type='smbios'>
Aug 09 00:54:14 user nova-compute[72780]:     <system>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='version'>0.0.0</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='serial'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='uuid'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:14 user nova-compute[72780]:       <entry name='family'>Virtual Machine</entry>
Aug 09 00:54:14 user nova-compute[72780]:     </system>
Aug 09 00:54:14 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:14 user nova-compute[72780]:   <os>
Aug 09 00:54:14 user nova-compute[72780]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 00:54:14 user nova-compute[72780]:     <boot dev='hd'/>
Aug 09 00:54:14 user nova-compute[72780]:     <smbios mode='sysinfo'/>
Aug 09 00:54:14 user nova-compute[72780]:   </os>
Aug 09 00:54:14 user nova-compute[72780]:   <features>
Aug 09 00:54:14 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:14 user nova-compute[72780]:     <apic/>
Aug 09 00:54:14 user nova-compute[72780]:     <vmcoreinfo state='on'/>
Aug 09 00:54:14 user nova-compute[72780]:   </features>
Aug 09 00:54:14 user nova-compute[72780]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 00:54:14 user nova-compute[72780]:     <model fallback='forbid'>Nehalem</model>
Aug 09 00:54:14 user nova-compute[72780]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 00:54:14 user nova-compute[72780]:     <feature policy='require' name='vme'/>
Aug 09 00:54:14 user nova-compute[72780]:     <feature policy='require' name='x2apic'/>
Aug 09 00:54:14 user nova-compute[72780]:     <feature policy='require' name='hypervisor'/>
Aug 09 00:54:14 user nova-compute[72780]:   </cpu>
Aug 09 00:54:14 user nova-compute[72780]:   <clock offset='utc'>
Aug 09 00:54:14 user nova-compute[72780]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 00:54:14 user nova-compute[72780]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 00:54:14 user nova-compute[72780]:     <timer name='hpet' present='no'/>
Aug 09 00:54:14 user nova-compute[72780]:   </clock>
Aug 09 00:54:14 user nova-compute[72780]:   <on_poweroff>destroy</on_poweroff>
Aug 09 00:54:14 user nova-compute[72780]:   <on_reboot>restart</on_reboot>
Aug 09 00:54:14 user nova-compute[72780]:   <on_crash>destroy</on_crash>
Aug 09 00:54:14 user nova-compute[72780]:   <devices>
Aug 09 00:54:14 user nova-compute[72780]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 00:54:14 user nova-compute[72780]:     <disk type='file' device='disk'>
Aug 09 00:54:14 user nova-compute[72780]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 00:54:14 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk' index='2'/>
Aug 09 00:54:14 user nova-compute[72780]:       <backingStore type='file' index='3'>
Aug 09 00:54:14 user nova-compute[72780]:         <format type='raw'/>
Aug 09 00:54:14 user nova-compute[72780]:         <source file='/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64'/>
Aug 09 00:54:14 user nova-compute[72780]:         <backingStore/>
Aug 09 00:54:14 user nova-compute[72780]:       </backingStore>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='vda' bus='virtio'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='virtio-disk0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </disk>
Aug 09 00:54:14 user nova-compute[72780]:     <disk type='file' device='cdrom'>
Aug 09 00:54:14 user nova-compute[72780]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 00:54:14 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config' index='1'/>
Aug 09 00:54:14 user nova-compute[72780]:       <backingStore/>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='hda' bus='ide'/>
Aug 09 00:54:14 user nova-compute[72780]:       <readonly/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='ide0-0-0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </disk>
Aug 09 00:54:14 user nova-compute[72780]:     <controller type='usb' index='0' model='none'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='usb'/>
Aug 09 00:54:14 user nova-compute[72780]:     </controller>
Aug 09 00:54:14 user nova-compute[72780]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='pci.0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </controller>
Aug 09 00:54:14 user nova-compute[72780]:     <controller type='ide' index='0'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='ide'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 00:54:14 user nova-compute[72780]:     </controller>
Aug 09 00:54:14 user nova-compute[72780]:     <interface type='ethernet'>
Aug 09 00:54:14 user nova-compute[72780]:       <mac address='fa:16:3e:81:35:4c'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target dev='tapd4522d9f-6e'/>
Aug 09 00:54:14 user nova-compute[72780]:       <model type='virtio'/>
Aug 09 00:54:14 user nova-compute[72780]:       <mtu size='1442'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='net0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </interface>
Aug 09 00:54:14 user nova-compute[72780]:     <serial type='pty'>
Aug 09 00:54:14 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:14 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target type='isa-serial' port='0'>
Aug 09 00:54:14 user nova-compute[72780]:         <model name='isa-serial'/>
Aug 09 00:54:14 user nova-compute[72780]:       </target>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </serial>
Aug 09 00:54:14 user nova-compute[72780]:     <console type='pty' tty='/dev/pts/6'>
Aug 09 00:54:14 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:14 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:14 user nova-compute[72780]:       <target type='serial' port='0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </console>
Aug 09 00:54:14 user nova-compute[72780]:     <input type='mouse' bus='ps2'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='input0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </input>
Aug 09 00:54:14 user nova-compute[72780]:     <input type='keyboard' bus='ps2'>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='input1'/>
Aug 09 00:54:14 user nova-compute[72780]:     </input>
Aug 09 00:54:14 user nova-compute[72780]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 00:54:14 user nova-compute[72780]:       <listen type='address' address='0.0.0.0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </graphics>
Aug 09 00:54:14 user nova-compute[72780]:     <audio id='1' type='none'/>
Aug 09 00:54:14 user nova-compute[72780]:     <video>
Aug 09 00:54:14 user nova-compute[72780]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='video0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </video>
Aug 09 00:54:14 user nova-compute[72780]:     <memballoon model='virtio'>
Aug 09 00:54:14 user nova-compute[72780]:       <stats period='10'/>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='balloon0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:14 user nova-compute[72780]:     <rng model='virtio'>
Aug 09 00:54:14 user nova-compute[72780]:       <backend model='random'>/dev/urandom</backend>
Aug 09 00:54:14 user nova-compute[72780]:       <alias name='rng0'/>
Aug 09 00:54:14 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 00:54:14 user nova-compute[72780]:     </rng>
Aug 09 00:54:14 user nova-compute[72780]:   </devices>
Aug 09 00:54:14 user nova-compute[72780]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 00:54:14 user nova-compute[72780]:     <label>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</label>
Aug 09 00:54:14 user nova-compute[72780]:     <imagelabel>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</imagelabel>
Aug 09 00:54:14 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:14 user nova-compute[72780]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 00:54:14 user nova-compute[72780]:     <label>+64055:+108</label>
Aug 09 00:54:14 user nova-compute[72780]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 00:54:14 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:14 user nova-compute[72780]: </domain>
Aug 09 00:54:14 user nova-compute[72780]:  {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 00:54:14 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully detached device tapc5bca965-e1 from instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 from the live domain config.
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG os_vif [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5bca965-e1, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:14 user nova-compute[72780]: INFO os_vif [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1')
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:14 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:54:14</nova:creationTime>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:54:14 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:owner>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:owner>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:14 user nova-compute[72780]:   <nova:ports>
Aug 09 00:54:14 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:54:14 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:14 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:14 user nova-compute[72780]:   </nova:ports>
Aug 09 00:54:14 user nova-compute[72780]: </nova:instance>
Aug 09 00:54:14 user nova-compute[72780]:  {{(pid=72780) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ec59cab-2a22-4f93-94d6-bee76e607d5e req-abe30da0-fbd6-4946-a55b-9561bfbee783 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-unplugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ec59cab-2a22-4f93-94d6-bee76e607d5e req-abe30da0-fbd6-4946-a55b-9561bfbee783 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ec59cab-2a22-4f93-94d6-bee76e607d5e req-abe30da0-fbd6-4946-a55b-9561bfbee783 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ec59cab-2a22-4f93-94d6-bee76e607d5e req-abe30da0-fbd6-4946-a55b-9561bfbee783 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ec59cab-2a22-4f93-94d6-bee76e607d5e req-abe30da0-fbd6-4946-a55b-9561bfbee783 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-unplugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:14 user nova-compute[72780]: WARNING nova.compute.manager [req-0ec59cab-2a22-4f93-94d6-bee76e607d5e req-abe30da0-fbd6-4946-a55b-9561bfbee783 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-unplugged-c5bca965-e170-4505-b56d-4b871b7d9733 for instance with vm_state active and task_state None.
Aug 09 00:54:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-deleted-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:15 user nova-compute[72780]: INFO nova.compute.manager [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Neutron deleted interface c5bca965-e170-4505-b56d-4b871b7d9733; detaching it from the instance and deleting it from the info cache
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7346MB free_disk=25.49142074584961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.objects.instance [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Lazy-loading 'system_metadata' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquired lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.objects.instance [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Lazy-loading 'flavor' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Converting VIF {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.utils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface> {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[269fbf12-8e1b-4970-a382-25dfaae810ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 00:54:15 user nova-compute[72780]:   <name>instance-00000007</name>
Aug 09 00:54:15 user nova-compute[72780]:   <uuid>78fd796d-5fbe-4352-9df8-7d718bc8bde2</uuid>
Aug 09 00:54:15 user nova-compute[72780]:   <metadata>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:15 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:54:14</nova:creationTime>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:54:15 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:owner>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:owner>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:ports>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:54:15 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:15 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:ports>
Aug 09 00:54:15 user nova-compute[72780]: </nova:instance>
Aug 09 00:54:15 user nova-compute[72780]:   </metadata>
Aug 09 00:54:15 user nova-compute[72780]:   <memory unit='KiB'>524288</memory>
Aug 09 00:54:15 user nova-compute[72780]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 00:54:15 user nova-compute[72780]:   <vcpu placement='static'>1</vcpu>
Aug 09 00:54:15 user nova-compute[72780]:   <resource>
Aug 09 00:54:15 user nova-compute[72780]:     <partition>/machine</partition>
Aug 09 00:54:15 user nova-compute[72780]:   </resource>
Aug 09 00:54:15 user nova-compute[72780]:   <sysinfo type='smbios'>
Aug 09 00:54:15 user nova-compute[72780]:     <system>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='version'>0.0.0</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='serial'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='uuid'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='family'>Virtual Machine</entry>
Aug 09 00:54:15 user nova-compute[72780]:     </system>
Aug 09 00:54:15 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:15 user nova-compute[72780]:   <os>
Aug 09 00:54:15 user nova-compute[72780]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 00:54:15 user nova-compute[72780]:     <boot dev='hd'/>
Aug 09 00:54:15 user nova-compute[72780]:     <smbios mode='sysinfo'/>
Aug 09 00:54:15 user nova-compute[72780]:   </os>
Aug 09 00:54:15 user nova-compute[72780]:   <features>
Aug 09 00:54:15 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:15 user nova-compute[72780]:     <apic/>
Aug 09 00:54:15 user nova-compute[72780]:     <vmcoreinfo state='on'/>
Aug 09 00:54:15 user nova-compute[72780]:   </features>
Aug 09 00:54:15 user nova-compute[72780]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 00:54:15 user nova-compute[72780]:     <model fallback='forbid'>Nehalem</model>
Aug 09 00:54:15 user nova-compute[72780]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 00:54:15 user nova-compute[72780]:     <feature policy='require' name='vme'/>
Aug 09 00:54:15 user nova-compute[72780]:     <feature policy='require' name='x2apic'/>
Aug 09 00:54:15 user nova-compute[72780]:     <feature policy='require' name='hypervisor'/>
Aug 09 00:54:15 user nova-compute[72780]:   </cpu>
Aug 09 00:54:15 user nova-compute[72780]:   <clock offset='utc'>
Aug 09 00:54:15 user nova-compute[72780]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 00:54:15 user nova-compute[72780]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 00:54:15 user nova-compute[72780]:     <timer name='hpet' present='no'/>
Aug 09 00:54:15 user nova-compute[72780]:   </clock>
Aug 09 00:54:15 user nova-compute[72780]:   <on_poweroff>destroy</on_poweroff>
Aug 09 00:54:15 user nova-compute[72780]:   <on_reboot>restart</on_reboot>
Aug 09 00:54:15 user nova-compute[72780]:   <on_crash>destroy</on_crash>
Aug 09 00:54:15 user nova-compute[72780]:   <devices>
Aug 09 00:54:15 user nova-compute[72780]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 00:54:15 user nova-compute[72780]:     <disk type='file' device='disk'>
Aug 09 00:54:15 user nova-compute[72780]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 00:54:15 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk' index='2'/>
Aug 09 00:54:15 user nova-compute[72780]:       <backingStore type='file' index='3'>
Aug 09 00:54:15 user nova-compute[72780]:         <format type='raw'/>
Aug 09 00:54:15 user nova-compute[72780]:         <source file='/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64'/>
Aug 09 00:54:15 user nova-compute[72780]:         <backingStore/>
Aug 09 00:54:15 user nova-compute[72780]:       </backingStore>
Aug 09 00:54:15 user nova-compute[72780]:       <target dev='vda' bus='virtio'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='virtio-disk0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </disk>
Aug 09 00:54:15 user nova-compute[72780]:     <disk type='file' device='cdrom'>
Aug 09 00:54:15 user nova-compute[72780]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 00:54:15 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config' index='1'/>
Aug 09 00:54:15 user nova-compute[72780]:       <backingStore/>
Aug 09 00:54:15 user nova-compute[72780]:       <target dev='hda' bus='ide'/>
Aug 09 00:54:15 user nova-compute[72780]:       <readonly/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='ide0-0-0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </disk>
Aug 09 00:54:15 user nova-compute[72780]:     <controller type='usb' index='0' model='none'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='usb'/>
Aug 09 00:54:15 user nova-compute[72780]:     </controller>
Aug 09 00:54:15 user nova-compute[72780]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='pci.0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </controller>
Aug 09 00:54:15 user nova-compute[72780]:     <controller type='ide' index='0'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='ide'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 00:54:15 user nova-compute[72780]:     </controller>
Aug 09 00:54:15 user nova-compute[72780]:     <interface type='ethernet'>
Aug 09 00:54:15 user nova-compute[72780]:       <mac address='fa:16:3e:81:35:4c'/>
Aug 09 00:54:15 user nova-compute[72780]:       <target dev='tapd4522d9f-6e'/>
Aug 09 00:54:15 user nova-compute[72780]:       <model type='virtio'/>
Aug 09 00:54:15 user nova-compute[72780]:       <mtu size='1442'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='net0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </interface>
Aug 09 00:54:15 user nova-compute[72780]:     <serial type='pty'>
Aug 09 00:54:15 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:15 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:15 user nova-compute[72780]:       <target type='isa-serial' port='0'>
Aug 09 00:54:15 user nova-compute[72780]:         <model name='isa-serial'/>
Aug 09 00:54:15 user nova-compute[72780]:       </target>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </serial>
Aug 09 00:54:15 user nova-compute[72780]:     <console type='pty' tty='/dev/pts/6'>
Aug 09 00:54:15 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:15 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:15 user nova-compute[72780]:       <target type='serial' port='0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </console>
Aug 09 00:54:15 user nova-compute[72780]:     <input type='mouse' bus='ps2'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='input0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </input>
Aug 09 00:54:15 user nova-compute[72780]:     <input type='keyboard' bus='ps2'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='input1'/>
Aug 09 00:54:15 user nova-compute[72780]:     </input>
Aug 09 00:54:15 user nova-compute[72780]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 00:54:15 user nova-compute[72780]:       <listen type='address' address='0.0.0.0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </graphics>
Aug 09 00:54:15 user nova-compute[72780]:     <audio id='1' type='none'/>
Aug 09 00:54:15 user nova-compute[72780]:     <video>
Aug 09 00:54:15 user nova-compute[72780]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='video0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </video>
Aug 09 00:54:15 user nova-compute[72780]:     <memballoon model='virtio'>
Aug 09 00:54:15 user nova-compute[72780]:       <stats period='10'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='balloon0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:15 user nova-compute[72780]:     <rng model='virtio'>
Aug 09 00:54:15 user nova-compute[72780]:       <backend model='random'>/dev/urandom</backend>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='rng0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </rng>
Aug 09 00:54:15 user nova-compute[72780]:   </devices>
Aug 09 00:54:15 user nova-compute[72780]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 00:54:15 user nova-compute[72780]:     <label>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</label>
Aug 09 00:54:15 user nova-compute[72780]:     <imagelabel>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</imagelabel>
Aug 09 00:54:15 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:15 user nova-compute[72780]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 00:54:15 user nova-compute[72780]:     <label>+64055:+108</label>
Aug 09 00:54:15 user nova-compute[72780]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 00:54:15 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:15 user nova-compute[72780]: </domain>
Aug 09 00:54:15 user nova-compute[72780]:  {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface> {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa79e7e-db33-46f9-bead-fb11e81dd301]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:03:37:42"/><model type="virtio"/><mtu size="1442"/><target dev="tapc5bca965-e1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 00:54:15 user nova-compute[72780]:   <name>instance-00000007</name>
Aug 09 00:54:15 user nova-compute[72780]:   <uuid>78fd796d-5fbe-4352-9df8-7d718bc8bde2</uuid>
Aug 09 00:54:15 user nova-compute[72780]:   <metadata>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:15 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:54:14</nova:creationTime>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:54:15 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:owner>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:owner>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:ports>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:54:15 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:15 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:ports>
Aug 09 00:54:15 user nova-compute[72780]: </nova:instance>
Aug 09 00:54:15 user nova-compute[72780]:   </metadata>
Aug 09 00:54:15 user nova-compute[72780]:   <memory unit='KiB'>524288</memory>
Aug 09 00:54:15 user nova-compute[72780]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 00:54:15 user nova-compute[72780]:   <vcpu placement='static'>1</vcpu>
Aug 09 00:54:15 user nova-compute[72780]:   <resource>
Aug 09 00:54:15 user nova-compute[72780]:     <partition>/machine</partition>
Aug 09 00:54:15 user nova-compute[72780]:   </resource>
Aug 09 00:54:15 user nova-compute[72780]:   <sysinfo type='smbios'>
Aug 09 00:54:15 user nova-compute[72780]:     <system>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='version'>0.0.0</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='serial'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='uuid'>78fd796d-5fbe-4352-9df8-7d718bc8bde2</entry>
Aug 09 00:54:15 user nova-compute[72780]:       <entry name='family'>Virtual Machine</entry>
Aug 09 00:54:15 user nova-compute[72780]:     </system>
Aug 09 00:54:15 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:15 user nova-compute[72780]:   <os>
Aug 09 00:54:15 user nova-compute[72780]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 00:54:15 user nova-compute[72780]:     <boot dev='hd'/>
Aug 09 00:54:15 user nova-compute[72780]:     <smbios mode='sysinfo'/>
Aug 09 00:54:15 user nova-compute[72780]:   </os>
Aug 09 00:54:15 user nova-compute[72780]:   <features>
Aug 09 00:54:15 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:15 user nova-compute[72780]:     <apic/>
Aug 09 00:54:15 user nova-compute[72780]:     <vmcoreinfo state='on'/>
Aug 09 00:54:15 user nova-compute[72780]:   </features>
Aug 09 00:54:15 user nova-compute[72780]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 00:54:15 user nova-compute[72780]:     <model fallback='forbid'>Nehalem</model>
Aug 09 00:54:15 user nova-compute[72780]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 00:54:15 user nova-compute[72780]:     <feature policy='require' name='vme'/>
Aug 09 00:54:15 user nova-compute[72780]:     <feature policy='require' name='x2apic'/>
Aug 09 00:54:15 user nova-compute[72780]:     <feature policy='require' name='hypervisor'/>
Aug 09 00:54:15 user nova-compute[72780]:   </cpu>
Aug 09 00:54:15 user nova-compute[72780]:   <clock offset='utc'>
Aug 09 00:54:15 user nova-compute[72780]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 00:54:15 user nova-compute[72780]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 00:54:15 user nova-compute[72780]:     <timer name='hpet' present='no'/>
Aug 09 00:54:15 user nova-compute[72780]:   </clock>
Aug 09 00:54:15 user nova-compute[72780]:   <on_poweroff>destroy</on_poweroff>
Aug 09 00:54:15 user nova-compute[72780]:   <on_reboot>restart</on_reboot>
Aug 09 00:54:15 user nova-compute[72780]:   <on_crash>destroy</on_crash>
Aug 09 00:54:15 user nova-compute[72780]:   <devices>
Aug 09 00:54:15 user nova-compute[72780]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 00:54:15 user nova-compute[72780]:     <disk type='file' device='disk'>
Aug 09 00:54:15 user nova-compute[72780]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 00:54:15 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk' index='2'/>
Aug 09 00:54:15 user nova-compute[72780]:       <backingStore type='file' index='3'>
Aug 09 00:54:15 user nova-compute[72780]:         <format type='raw'/>
Aug 09 00:54:15 user nova-compute[72780]:         <source file='/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64'/>
Aug 09 00:54:15 user nova-compute[72780]:         <backingStore/>
Aug 09 00:54:15 user nova-compute[72780]:       </backingStore>
Aug 09 00:54:15 user nova-compute[72780]:       <target dev='vda' bus='virtio'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='virtio-disk0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </disk>
Aug 09 00:54:15 user nova-compute[72780]:     <disk type='file' device='cdrom'>
Aug 09 00:54:15 user nova-compute[72780]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 00:54:15 user nova-compute[72780]:       <source file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/disk.config' index='1'/>
Aug 09 00:54:15 user nova-compute[72780]:       <backingStore/>
Aug 09 00:54:15 user nova-compute[72780]:       <target dev='hda' bus='ide'/>
Aug 09 00:54:15 user nova-compute[72780]:       <readonly/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='ide0-0-0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </disk>
Aug 09 00:54:15 user nova-compute[72780]:     <controller type='usb' index='0' model='none'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='usb'/>
Aug 09 00:54:15 user nova-compute[72780]:     </controller>
Aug 09 00:54:15 user nova-compute[72780]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='pci.0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </controller>
Aug 09 00:54:15 user nova-compute[72780]:     <controller type='ide' index='0'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='ide'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 00:54:15 user nova-compute[72780]:     </controller>
Aug 09 00:54:15 user nova-compute[72780]:     <interface type='ethernet'>
Aug 09 00:54:15 user nova-compute[72780]:       <mac address='fa:16:3e:81:35:4c'/>
Aug 09 00:54:15 user nova-compute[72780]:       <target dev='tapd4522d9f-6e'/>
Aug 09 00:54:15 user nova-compute[72780]:       <model type='virtio'/>
Aug 09 00:54:15 user nova-compute[72780]:       <mtu size='1442'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='net0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </interface>
Aug 09 00:54:15 user nova-compute[72780]:     <serial type='pty'>
Aug 09 00:54:15 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:15 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:15 user nova-compute[72780]:       <target type='isa-serial' port='0'>
Aug 09 00:54:15 user nova-compute[72780]:         <model name='isa-serial'/>
Aug 09 00:54:15 user nova-compute[72780]:       </target>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </serial>
Aug 09 00:54:15 user nova-compute[72780]:     <console type='pty' tty='/dev/pts/6'>
Aug 09 00:54:15 user nova-compute[72780]:       <source path='/dev/pts/6'/>
Aug 09 00:54:15 user nova-compute[72780]:       <log file='/opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2/console.log' append='off'/>
Aug 09 00:54:15 user nova-compute[72780]:       <target type='serial' port='0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='serial0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </console>
Aug 09 00:54:15 user nova-compute[72780]:     <input type='mouse' bus='ps2'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='input0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </input>
Aug 09 00:54:15 user nova-compute[72780]:     <input type='keyboard' bus='ps2'>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='input1'/>
Aug 09 00:54:15 user nova-compute[72780]:     </input>
Aug 09 00:54:15 user nova-compute[72780]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 00:54:15 user nova-compute[72780]:       <listen type='address' address='0.0.0.0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </graphics>
Aug 09 00:54:15 user nova-compute[72780]:     <audio id='1' type='none'/>
Aug 09 00:54:15 user nova-compute[72780]:     <video>
Aug 09 00:54:15 user nova-compute[72780]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='video0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </video>
Aug 09 00:54:15 user nova-compute[72780]:     <memballoon model='virtio'>
Aug 09 00:54:15 user nova-compute[72780]:       <stats period='10'/>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='balloon0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:15 user nova-compute[72780]:     <rng model='virtio'>
Aug 09 00:54:15 user nova-compute[72780]:       <backend model='random'>/dev/urandom</backend>
Aug 09 00:54:15 user nova-compute[72780]:       <alias name='rng0'/>
Aug 09 00:54:15 user nova-compute[72780]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 00:54:15 user nova-compute[72780]:     </rng>
Aug 09 00:54:15 user nova-compute[72780]:   </devices>
Aug 09 00:54:15 user nova-compute[72780]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 00:54:15 user nova-compute[72780]:     <label>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</label>
Aug 09 00:54:15 user nova-compute[72780]:     <imagelabel>libvirt-78fd796d-5fbe-4352-9df8-7d718bc8bde2</imagelabel>
Aug 09 00:54:15 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:15 user nova-compute[72780]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 00:54:15 user nova-compute[72780]:     <label>+64055:+108</label>
Aug 09 00:54:15 user nova-compute[72780]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 00:54:15 user nova-compute[72780]:   </seclabel>
Aug 09 00:54:15 user nova-compute[72780]: </domain>
Aug 09 00:54:15 user nova-compute[72780]:  {{(pid=72780) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 00:54:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Detaching interface fa:16:3e:03:37:42 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc5bca965-e1' not found.
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Converting VIF {"id": "c5bca965-e170-4505-b56d-4b871b7d9733", "address": "fa:16:3e:03:37:42", "network": {"id": "124b3025-0898-4f0f-803b-95c76ebde53f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-939524280", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5bca965-e1", "ovs_interfaceid": "c5bca965-e170-4505-b56d-4b871b7d9733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_vif [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 3d08d366-e309-4fb6-a784-6e160822b587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 2550fbbd-c0ed-405a-b756-d834138028ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 0e0fc6f8-5e07-421e-a841-de1c73a7b41e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance b4bad65f-909e-4a75-a4d0-bf81f89dcc84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[290e1e41-bb2d-4249-b6a0-8bb577519f49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5bca965-e1, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffac22d8-19d5-4f2f-b8cf-54c061812e42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: INFO os_vif [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:37:42,bridge_name='br-int',has_traffic_filtering=True,id=c5bca965-e170-4505-b56d-4b871b7d9733,network=Network(124b3025-0898-4f0f-803b-95c76ebde53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5bca965-e1')
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [req-3edd979a-6602-484e-a846-654d86f29183 req-d3a8cfcd-6e41-4401-8af8-931834e24b3c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:15 user nova-compute[72780]:   <nova:package version="0.0.0"/>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:name>tempest-device-tagging-server-2088268164</nova:name>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:creationTime>2023-08-09 00:54:15</nova:creationTime>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:flavor name="m1.tiny">
Aug 09 00:54:15 user nova-compute[72780]:     <nova:memory>512</nova:memory>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:disk>1</nova:disk>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:swap>0</nova:swap>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:flavor>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:owner>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:user uuid="53f1daff87854ba49adc00cd53ae85f0">tempest-TaggedAttachmentsTest-1330377732-project-member</nova:user>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:project uuid="15a75d1aa47c4c2580cf976ecc9be560">tempest-TaggedAttachmentsTest-1330377732</nova:project>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:owner>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:15 user nova-compute[72780]:   <nova:ports>
Aug 09 00:54:15 user nova-compute[72780]:     <nova:port uuid="d4522d9f-6eba-45f7-b5df-82d8d36410bc">
Aug 09 00:54:15 user nova-compute[72780]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:15 user nova-compute[72780]:     </nova:port>
Aug 09 00:54:15 user nova-compute[72780]:   </nova:ports>
Aug 09 00:54:15 user nova-compute[72780]: </nova:instance>
Aug 09 00:54:15 user nova-compute[72780]:  {{(pid=72780) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:54:15 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23a807-a0ae-4fbd-a705-3289d6bacc4b]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.utils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] <== get_connector_properties: return (270ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfBqcKYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:15 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b1c4f-87e8-45fb-b878-37c1ad4e4a5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:54:15 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ccc8b0-8ac3-4a03-a6a5-9781e8b4686c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04] added
Aug 09 00:54:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0466838a-582f-40ae-8e65-6931bdfdef69]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf1a02-8603-4aa7-a00f-bff2826be71d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfBqcKYV {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: INFO nova.compute.manager [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Swapping volume ebd4aa80-edbd-4882-9e99-89db2a5f1205 for f16f9eed-1228-48d9-afed-3b43a3c0593d
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfBqcKYV" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5db4f4-8718-4418-83d0-160b20ebf359]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfBqcKYV'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ef19d-5a60-42e7-8565-67b8cb31e117]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f274d36-61e8-4288-b315-d5c63ece188f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455da21-fcc7-4d17-980b-70f1d770ad15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260]
Aug 09 00:54:16 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[192eba92-19a3-4d08-887d-6f033249d18c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad81b1-8deb-4e29-b81b-4f20aa909aad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:16 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [{"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba67e9-14b6-4fc6-8243-49ad5b5199ae]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Releasing lock "refresh_cache-78fd796d-5fbe-4352-9df8-7d718bc8bde2" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eededc22-3a61-4d60-9275-45ef8afd8e71 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "interface-78fd796d-5fbe-4352-9df8-7d718bc8bde2-c5bca965-e170-4505-b56d-4b871b7d9733" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.382s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-971135a2-e689-4352-a3ba-8ba6aedf61c6 req-a62186a2-8fde-48c6-a93e-3eaecef8404d service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-971135a2-e689-4352-a3ba-8ba6aedf61c6 req-a62186a2-8fde-48c6-a93e-3eaecef8404d service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-971135a2-e689-4352-a3ba-8ba6aedf61c6 req-a62186a2-8fde-48c6-a93e-3eaecef8404d service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-971135a2-e689-4352-a3ba-8ba6aedf61c6 req-a62186a2-8fde-48c6-a93e-3eaecef8404d service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-971135a2-e689-4352-a3ba-8ba6aedf61c6 req-a62186a2-8fde-48c6-a93e-3eaecef8404d service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:16 user nova-compute[72780]: WARNING nova.compute.manager [req-971135a2-e689-4352-a3ba-8ba6aedf61c6 req-a62186a2-8fde-48c6-a93e-3eaecef8404d service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-c5bca965-e170-4505-b56d-4b871b7d9733 for instance with vm_state active and task_state None.
Aug 09 00:54:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfBqcKYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23762623536343636', 'path': '/dev/sdj'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762623536343636', 'path': '/dev/sdj'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG nova.objects.instance [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lazy-loading 'flavor' on Instance uuid 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:54:17 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:17 user nova-compute[72780]:   <source dev="/dev/sdj"/>
Aug 09 00:54:17 user nova-compute[72780]:   <target dev="sdc" bus="scsi"/>
Aug 09 00:54:17 user nova-compute[72780]:   <serial>b6e1b130-f645-47cd-b0f2-c1ec6ba6af04</serial>
Aug 09 00:54:17 user nova-compute[72780]:   <address type="drive" controller="0" unit="2"/>
Aug 09 00:54:17 user nova-compute[72780]: </disk>
Aug 09 00:54:17 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:54:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No BDM found with device name sda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] No VIF found with MAC fa:16:3e:bb:6a:29, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12ecb860-c6cc-4532-84c0-2c8276545f45 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.861s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:19 user nova-compute[72780]: INFO nova.compute.manager [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Detaching volume b6e1b130-f645-47cd-b0f2-c1ec6ba6af04
Aug 09 00:54:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:19 user nova-compute[72780]: INFO nova.virt.block_device [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Attempting to driver detach volume b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 from mountpoint /dev/sdc
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Attempting to detach device sdc from instance 3d08d366-e309-4fb6-a784-6e160822b587 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:19 user nova-compute[72780]:   <source dev="/dev/sdj"/>
Aug 09 00:54:19 user nova-compute[72780]:   <target dev="sdc" bus="scsi"/>
Aug 09 00:54:19 user nova-compute[72780]:   <serial>b6e1b130-f645-47cd-b0f2-c1ec6ba6af04</serial>
Aug 09 00:54:19 user nova-compute[72780]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 00:54:19 user nova-compute[72780]: </disk>
Aug 09 00:54:19 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Successfully detached device sdc from instance 3d08d366-e309-4fb6-a784-6e160822b587 from the persistent domain config.
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3d08d366-e309-4fb6-a784-6e160822b587 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:19 user nova-compute[72780]:   <source dev="/dev/sdj"/>
Aug 09 00:54:19 user nova-compute[72780]:   <target dev="sdc" bus="scsi"/>
Aug 09 00:54:19 user nova-compute[72780]:   <serial>b6e1b130-f645-47cd-b0f2-c1ec6ba6af04</serial>
Aug 09 00:54:19 user nova-compute[72780]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 00:54:19 user nova-compute[72780]: </disk>
Aug 09 00:54:19 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:54:19 user nova-compute[72780]: INFO nova.compute.claims [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Claim successful on node user
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542459.897293, 3d08d366-e309-4fb6-a784-6e160822b587 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:54:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Successfully detached device sdc from instance 3d08d366-e309-4fb6-a784-6e160822b587 from the live domain config.
Aug 09 00:54:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfBqcKYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285b563-ddae-4fa3-abed-d10be83f5e3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c22e9-694a-4489-8326-c48fb194fc2a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:19 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac06d6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04'): ({'sdj'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Removing single pathed devices sdj {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bee320-0d00-4a00-94ac-bb0ff5dba275]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c5afbb-a124-43a7-b1e9-14ca492c36c8]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Flushing IO for device /dev/sdj {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5898ee-bfd7-4ce9-853a-d3323bf2d867]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf428a7a-451a-4295-8d26-8737cd01ef69]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] SCSI volumes sdj have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b3a79-fdea-413f-a846-8859ba3dd69e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2494f26-3435-461b-af41-305d76b187c2]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260]
Aug 09 00:54:20 user nova-compute[72780]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e1b130-f645-47cd-b0f2-c1ec6ba6af04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d8307b-5e93-4418-8a72-e97177e1facd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] <== disconnect_volume: return (393ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.policy [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bade11d5ae3a4aa4bca3a34aa14298ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9106ffe1447fa6b5ee6fbfc58417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:54:20 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Creating image(s)
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "/opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "/opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "/opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.193s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.160s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk 1073741824" returned: 0 in 0.055s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Successfully created port: 80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Cannot resize image /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.objects.instance [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'migration_context' on Instance uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lazy-loading 'flavor' on Instance uuid 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Ensure instance console log exists: /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4f3103fd-9030-4656-97fe-27640c35ea61 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Successfully updated port: 80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquired lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-changed-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Refreshing instance network info cache due to event network-changed-80ff0d44-4460-40ea-b37a-21d59b3a80da. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:54:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] Acquiring lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:22 user nova-compute[72780]: INFO nova.compute.manager [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Terminating instance
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating instance_info_cache with network_info: [{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Releasing lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Instance network_info: |[{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] Acquired lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.neutron [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Refreshing network info cache for port 80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Start _get_guest_xml network_info=[{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:54:22 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:22 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-84990694',display_name='tempest-TestStampPattern-server-84990694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84990694',id=11,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI07VMD4TclndvCxE6L38Kfcl2+xDDK4chst8IOjrrMvWh8Il4bIaWiI0srekfxk1YveAsel1TDoaTLMrNZK/VdAns7XVogJbCxdGHNJMvvjMwF4xr/mRlMFXTrSY23piA==',key_name='tempest-TestStampPattern-2067735695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa1d9106ffe1447fa6b5ee6fbfc58417',ramdisk_id='',reservation_id='r-9hz96s5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-753935542',owner_user_name='tempest-TestStampPattern-753935542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:20Z,user_data=None,user_id='bade11d5ae3a4aa4bca3a34aa14298ce',uuid=abc4a45e-2b7e-4038-9e67-a16a419e43bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converting VIF {"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.objects.instance [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'pci_devices' on Instance uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:54:22 user nova-compute[72780]:   <uuid>abc4a45e-2b7e-4038-9e67-a16a419e43bb</uuid>
Aug 09 00:54:22 user nova-compute[72780]:   <name>instance-0000000b</name>
Aug 09 00:54:22 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:54:22 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:54:22 user nova-compute[72780]:   <metadata>
Aug 09 00:54:22 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:22 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:54:22 user nova-compute[72780]:       <nova:name>tempest-TestStampPattern-server-84990694</nova:name>
Aug 09 00:54:22 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:54:22</nova:creationTime>
Aug 09 00:54:22 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:54:22 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:22 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:54:22 user nova-compute[72780]:       <nova:owner>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:user uuid="bade11d5ae3a4aa4bca3a34aa14298ce">tempest-TestStampPattern-753935542-project-member</nova:user>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:project uuid="fa1d9106ffe1447fa6b5ee6fbfc58417">tempest-TestStampPattern-753935542</nova:project>
Aug 09 00:54:22 user nova-compute[72780]:       </nova:owner>
Aug 09 00:54:22 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:22 user nova-compute[72780]:       <nova:ports>
Aug 09 00:54:22 user nova-compute[72780]:         <nova:port uuid="80ff0d44-4460-40ea-b37a-21d59b3a80da">
Aug 09 00:54:22 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 00:54:22 user nova-compute[72780]:         </nova:port>
Aug 09 00:54:22 user nova-compute[72780]:       </nova:ports>
Aug 09 00:54:22 user nova-compute[72780]:     </nova:instance>
Aug 09 00:54:22 user nova-compute[72780]:   </metadata>
Aug 09 00:54:22 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:54:22 user nova-compute[72780]:     <system>
Aug 09 00:54:22 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:54:22 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:54:22 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:54:22 user nova-compute[72780]:       <entry name="serial">abc4a45e-2b7e-4038-9e67-a16a419e43bb</entry>
Aug 09 00:54:22 user nova-compute[72780]:       <entry name="uuid">abc4a45e-2b7e-4038-9e67-a16a419e43bb</entry>
Aug 09 00:54:22 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:54:22 user nova-compute[72780]:     </system>
Aug 09 00:54:22 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:22 user nova-compute[72780]:   <os>
Aug 09 00:54:22 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:54:22 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:54:22 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:54:22 user nova-compute[72780]:   </os>
Aug 09 00:54:22 user nova-compute[72780]:   <features>
Aug 09 00:54:22 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:22 user nova-compute[72780]:     <apic/>
Aug 09 00:54:22 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:54:22 user nova-compute[72780]:   </features>
Aug 09 00:54:22 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:54:22 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:54:22 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:54:22 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:54:22 user nova-compute[72780]:   </clock>
Aug 09 00:54:22 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:54:22 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:54:22 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:54:22 user nova-compute[72780]:   </cpu>
Aug 09 00:54:22 user nova-compute[72780]:   <devices>
Aug 09 00:54:22 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:54:22 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:54:22 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk"/>
Aug 09 00:54:22 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:54:22 user nova-compute[72780]:     </disk>
Aug 09 00:54:22 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:54:22 user nova-compute[72780]:       <mac address="fa:16:3e:45:32:bd"/>
Aug 09 00:54:22 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:54:22 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:54:22 user nova-compute[72780]:       <target dev="tap80ff0d44-44"/>
Aug 09 00:54:22 user nova-compute[72780]:     </interface>
Aug 09 00:54:22 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:54:22 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/console.log" append="off"/>
Aug 09 00:54:22 user nova-compute[72780]:     </serial>
Aug 09 00:54:22 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:54:22 user nova-compute[72780]:     <video>
Aug 09 00:54:22 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:54:22 user nova-compute[72780]:     </video>
Aug 09 00:54:22 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:54:22 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:54:22 user nova-compute[72780]:     </rng>
Aug 09 00:54:22 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:54:22 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:54:22 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:54:22 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:22 user nova-compute[72780]:   </devices>
Aug 09 00:54:22 user nova-compute[72780]: </domain>
Aug 09 00:54:22 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-84990694',display_name='tempest-TestStampPattern-server-84990694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84990694',id=11,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI07VMD4TclndvCxE6L38Kfcl2+xDDK4chst8IOjrrMvWh8Il4bIaWiI0srekfxk1YveAsel1TDoaTLMrNZK/VdAns7XVogJbCxdGHNJMvvjMwF4xr/mRlMFXTrSY23piA==',key_name='tempest-TestStampPattern-2067735695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa1d9106ffe1447fa6b5ee6fbfc58417',ramdisk_id='',reservation_id='r-9hz96s5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-753935542',owner_user_name='tempest-TestStampPattern-753935542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:20Z,user_data=None,user_id='bade11d5ae3a4aa4bca3a34aa14298ce',uuid=abc4a45e-2b7e-4038-9e67-a16a419e43bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converting VIF {"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG os_vif [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80ff0d44-44, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80ff0d44-44, col_values=(('external_ids', {'iface-id': '80ff0d44-4460-40ea-b37a-21d59b3a80da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:32:bd', 'vm-uuid': 'abc4a45e-2b7e-4038-9e67-a16a419e43bb'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:22 user nova-compute[72780]: INFO os_vif [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44')
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No VIF found with MAC fa:16:3e:45:32:bd, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-99250e49-a09c-4823-9ecf-3de7ca9c2e18 req-64fd285a-6567-4703-a9fa-da43bef2b9b1 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-vif-unplugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-99250e49-a09c-4823-9ecf-3de7ca9c2e18 req-64fd285a-6567-4703-a9fa-da43bef2b9b1 service nova] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-99250e49-a09c-4823-9ecf-3de7ca9c2e18 req-64fd285a-6567-4703-a9fa-da43bef2b9b1 service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-99250e49-a09c-4823-9ecf-3de7ca9c2e18 req-64fd285a-6567-4703-a9fa-da43bef2b9b1 service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-99250e49-a09c-4823-9ecf-3de7ca9c2e18 req-64fd285a-6567-4703-a9fa-da43bef2b9b1 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] No waiting events found dispatching network-vif-unplugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-99250e49-a09c-4823-9ecf-3de7ca9c2e18 req-64fd285a-6567-4703-a9fa-da43bef2b9b1 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-vif-unplugged-cdcb5023-00c6-4098-9205-e770c82ffdea for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updated VIF entry in instance network info cache for port 80ff0d44-4460-40ea-b37a-21d59b3a80da. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating instance_info_cache with network_info: [{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-318243c6-4a20-49dd-a872-e323200e5ab9 req-bdfe9bfa-13af-46a4-bf45-d13ffc58ee21 service nova] Releasing lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Instance destroyed successfully.
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.objects.instance [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lazy-loading 'resources' on Instance uuid 3d08d366-e309-4fb6-a784-6e160822b587 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1857886325',display_name='tempest-AttachSCSIVolumeTestJSON-server-1857886325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1857886325',id=5,image_ref='fc963ee7-8c25-4ef2-ae17-73b2b19490f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfnuhxZegHLjj7Af1Sldl2E+NouDwEzPx1X5PiPCRI3k+cjzqvC5QCBqX1GgoEMPUBZsOGQ4vTtx4sGhrLIjt0xcLQ2Uj8MY0usYRFdXOgAarBPcHnc1sj/mH/HdtXStg==',key_name='tempest-keypair-287614061',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27a246ec7574c03a37e420bdfa68ebd',ramdisk_id='',reservation_id='r-0md68je0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc963ee7-8c25-4ef2-ae17-73b2b19490f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1349278350',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1349278350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f03239c6ad4689b36cf7b3ebe65d80',uuid=3d08d366-e309-4fb6-a784-6e160822b587,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Converting VIF {"id": "cdcb5023-00c6-4098-9205-e770c82ffdea", "address": "fa:16:3e:bb:6a:29", "network": {"id": "1a19f2a5-d363-49f7-a349-0460d006de57", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1993641669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27a246ec7574c03a37e420bdfa68ebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcb5023-00", "ovs_interfaceid": "cdcb5023-00c6-4098-9205-e770c82ffdea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG os_vif [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdcb5023-00, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:24 user nova-compute[72780]: INFO os_vif [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:6a:29,bridge_name='br-int',has_traffic_filtering=True,id=cdcb5023-00c6-4098-9205-e770c82ffdea,network=Network(1a19f2a5-d363-49f7-a349-0460d006de57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcb5023-00')
Aug 09 00:54:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Deleting instance files /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587_del
Aug 09 00:54:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Deletion of /opt/stack/data/nova/instances/3d08d366-e309-4fb6-a784-6e160822b587_del complete
Aug 09 00:54:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:54:24 user nova-compute[72780]: INFO nova.compute.claims [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Claim successful on node user
Aug 09 00:54:24 user nova-compute[72780]: INFO nova.compute.manager [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Took 1.99 seconds to destroy the instance on the hypervisor.
Aug 09 00:54:24 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:54:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:24 user nova-compute[72780]: INFO nova.virt.block_device [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Booting with blank volume at /dev/vda
Aug 09 00:54:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG nova.policy [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c93725c6c7e4001b478b1c87d6ba759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d09b1579894f47877a117276c7465f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:54:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-8cb49ee0-ea87-4245-abc2-ae2490450a47 req-20d39d75-5cd1-43d0-8462-54d3176716be service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8cb49ee0-ea87-4245-abc2-ae2490450a47 req-20d39d75-5cd1-43d0-8462-54d3176716be service nova] Acquiring lock "3d08d366-e309-4fb6-a784-6e160822b587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8cb49ee0-ea87-4245-abc2-ae2490450a47 req-20d39d75-5cd1-43d0-8462-54d3176716be service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8cb49ee0-ea87-4245-abc2-ae2490450a47 req-20d39d75-5cd1-43d0-8462-54d3176716be service nova] Lock "3d08d366-e309-4fb6-a784-6e160822b587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-8cb49ee0-ea87-4245-abc2-ae2490450a47 req-20d39d75-5cd1-43d0-8462-54d3176716be service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] No waiting events found dispatching network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:25 user nova-compute[72780]: WARNING nova.compute.manager [req-8cb49ee0-ea87-4245-abc2-ae2490450a47 req-20d39d75-5cd1-43d0-8462-54d3176716be service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received unexpected event network-vif-plugged-cdcb5023-00c6-4098-9205-e770c82ffdea for instance with vm_state active and task_state deleting.
Aug 09 00:54:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-77168e9a-83f5-4879-b1c9-b4519f6f4f97 req-a7983a13-1ecd-4c87-8b31-9a834ce4825e service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-77168e9a-83f5-4879-b1c9-b4519f6f4f97 req-a7983a13-1ecd-4c87-8b31-9a834ce4825e service nova] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-77168e9a-83f5-4879-b1c9-b4519f6f4f97 req-a7983a13-1ecd-4c87-8b31-9a834ce4825e service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-77168e9a-83f5-4879-b1c9-b4519f6f4f97 req-a7983a13-1ecd-4c87-8b31-9a834ce4825e service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-77168e9a-83f5-4879-b1c9-b4519f6f4f97 req-a7983a13-1ecd-4c87-8b31-9a834ce4825e service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] No waiting events found dispatching network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:25 user nova-compute[72780]: WARNING nova.compute.manager [req-77168e9a-83f5-4879-b1c9-b4519f6f4f97 req-a7983a13-1ecd-4c87-8b31-9a834ce4825e service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received unexpected event network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da for instance with vm_state building and task_state spawning.
Aug 09 00:54:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:25 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:25 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Took 1.84 seconds to deallocate network for instance.
Aug 09 00:54:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Successfully created port: 6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:54:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:26 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:54:26 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:54:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:26 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Deleted allocations for instance 3d08d366-e309-4fb6-a784-6e160822b587
Aug 09 00:54:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-34600db6-e5d3-4b21-afe6-7f960e8ea7f0 tempest-AttachSCSIVolumeTestJSON-1349278350 tempest-AttachSCSIVolumeTestJSON-1349278350-project-member] Lock "3d08d366-e309-4fb6-a784-6e160822b587" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.573s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542467.020542, abc4a45e-2b7e-4038-9e67-a16a419e43bb => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] VM Resumed (Lifecycle Event)
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Instance spawned successfully.
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542467.0238397, abc4a45e-2b7e-4038-9e67-a16a419e43bb => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] VM Started (Lifecycle Event)
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:27 user nova-compute[72780]: INFO nova.compute.manager [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Took 7.56 seconds to build instance.
Aug 09 00:54:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-def16f5a-b560-439b-b02c-05a13acedfa2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.698s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Received event network-vif-deleted-cdcb5023-00c6-4098-9205-e770c82ffdea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] No waiting events found dispatching network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:27 user nova-compute[72780]: WARNING nova.compute.manager [req-2c3e4abb-d516-4c32-8130-3b60020dc22a req-87d04ffe-5454-4b1e-9b35-16e6edfb1bd2 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received unexpected event network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da for instance with vm_state active and task_state None.
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Successfully updated port: 6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-changed-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Refreshing instance network info cache due to event network-changed-6fedb901-867a-4ae8-80c4-1da838b3e44e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] Acquiring lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance network_info: |[{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] Acquired lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG nova.network.neutron [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Refreshing network info cache for port 6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:54:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updated VIF entry in instance network info cache for port 6fedb901-867a-4ae8-80c4-1da838b3e44e. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:54:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9d39a7b2-ce98-40f1-8f6e-8009c1645b71 req-5cc97b7c-edb2-4137-9ccf-61cff81751bc service nova] Releasing lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LivMUcfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f16f9eed-1228-48d9-afed-3b43a3c0593d', 'serial': 'f16f9eed-1228-48d9-afed-3b43a3c0593d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebd4aa80-edbd-4882-9e99-89db2a5f1205', 'serial'} {{(pid=72780) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LivMUcfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:30 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:30 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:30 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c696902-3737-4e5f-ab3d-142f61bc6b78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:54:30 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4722b631-586a-4ff3-a936-d1095d84a36f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d] added
Aug 09 00:54:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.utils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[925604a4-2b80-48ed-89f4-3d505147bd9d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[be03e96c-41c7-444c-88f3-4c22fb5bb723]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1dc89d-e52d-467f-8f0a-a44bbb2e4341]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89523b94-30f1-46a3-9cae-337cd8a52e90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LivMUcfE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LivMUcfE" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb878acc-a7db-4900-9d9d-81946f6f4c1b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56732257-393d-4b2c-8b72-2c539a345f74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LivMUcfE'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780febb-09be-438b-9951-bca693f23ed7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[69695de7-82a9-472b-978f-dbb9b426a749]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:54:30 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d652d-1072-4ea3-b648-6f004cf8d6b3]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.utils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating existing volume attachment record: 9594dfee-e9d3-432a-a3fb-a9564b0d629f {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bb24b6-d46a-4a89-8f12-48d6b3fb8380]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca2298-1d2c-4e17-9b2c-d96af7f3fda6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260]
Aug 09 00:54:30 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f88709-d4e2-4cbe-8117-9fac677d2fde]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d31a2-b7ee-4ee3-9de7-b6ae2de08cdc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:30 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf0328d-dff9-403e-93af-8ffe80eb67eb]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LivMUcfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:54:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23861323463346462', 'path': '/dev/sdj'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861323463346462', 'path': '/dev/sdj'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lazy-loading 'flavor' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 87031808 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 273678336 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 565182464 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 683671552 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 818937856 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 939524096 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:36 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af9aa4c-70f1-4ace-b041-5b8907aa4173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[862cbd5f-4d00-41fe-b459-4d592f7c2eb3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:36 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0565cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'): ({'sdi'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Removing single pathed devices sdi {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09849d6-f1f1-4169-ac5a-db370878f0af]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feb8c72-d5f7-4b52-aea5-9750f1079eab]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Flushing IO for device /dev/sdi {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f00f8-1c49-476b-b290-28373163044b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a39a35-ec31-4446-988b-4c4517341696]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] SCSI volumes sdi have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[609a1981-7e7e-41b8-9fce-e26e0dd4b488]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3013f789-754a-4ccc-b8aa-af4a1b33d2de]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]
Aug 09 00:54:37 user nova-compute[72780]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:37 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40be5cf-4959-4197-9d10-4241d4fa16bf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] <== disconnect_volume: return (408ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LivMUcfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f16f9eed-1228-48d9-afed-3b43a3c0593d', 'serial'} {{(pid=72780) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] swap_volume: removing Cinder connection for volume ebd4aa80-edbd-4882-9e99-89db2a5f1205 {{(pid=72780) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 00:54:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] swap_volume: Updating volume ebd4aa80-edbd-4882-9e99-89db2a5f1205 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "LivMUcfE", "auth_password": "RXivAhISkJGZgO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "f16f9eed-1228-48d9-afed-3b43a3c0593d"}, "status": "reserved", "instance": "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e", "attached_at": "", "detached_at": "", "volume_id": "f16f9eed-1228-48d9-afed-3b43a3c0593d", "serial": "f16f9eed-1228-48d9-afed-3b43a3c0593d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f16f9eed-1228-48d9-afed-3b43a3c0593d', 'no_device': None, 'attachment_id': 'ca1b484b-210f-4ec4-a045-789e6ba6c9d1'} {{(pid=72780) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 00:54:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6768aec9-60e0-43f7-8a9b-0bd341693797 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.146s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:38 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542463.9626174, 3d08d366-e309-4fb6-a784-6e160822b587 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:38 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] VM Stopped (Lifecycle Event)
Aug 09 00:54:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b0f03bdf-8d26-4157-9c0b-4bd8195a2794 None None] [instance: 3d08d366-e309-4fb6-a784-6e160822b587] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG os_brick.utils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb64586-04c0-406c-aee9-c4c442903cc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100cc3a-d4b2-4bbd-a311-fd393dcf2308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d1434b-9c24-41df-bb50-ddcfd77f0f26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0982462a-9033-4278-acb2-9b18538f5259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:54:39 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:54:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e1259-25dc-44a7-be43-3a969c9cbf74]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:54:39 user nova-compute[72780]: DEBUG os_brick.utils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:39 user nova-compute[72780]: INFO nova.compute.manager [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Swapping volume f16f9eed-1228-48d9-afed-3b43a3c0593d for ebd4aa80-edbd-4882-9e99-89db2a5f1205
Aug 09 00:54:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:54:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Creating image(s)
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Ensure instance console log exists: /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Start _get_guest_xml network_info=[{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a76eeaad-0c42-45c7-8351-a3dacdad0574', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6e76589-9c1b-45b8-8b1b-28007ff9400f', 'serial': 'd6e76589-9c1b-45b8-8b1b-28007ff9400f'}, 'disk_bus': 'virtio', 'attachment_id': '9594dfee-e9d3-432a-a3fb-a9564b0d629f', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:54:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:42 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9170125c-a5c3-4410-a136-1109a524e86c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:54:42 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c33f44b-fa86-4d25-b9e9-b7f5a9c461be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f] added
Aug 09 00:54:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ec276-b331-4d84-9440-05270ab2653f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f58a9-0d9b-4236-b6d6-73f42da15fa6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfITxHNB {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfITxHNB" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83cc87-341d-4cf2-a794-30ffd927ced3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RfITxHNB'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5118b0-b69b-4c69-8b1c-c66ff580f7d0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a96a5-4fa9-443a-8190-2fc147d321c1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35659336-d5b5-4ace-812a-3b8de9c78b1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260]
Aug 09 00:54:43 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3384ae-7bdd-4115-83d0-a82b31165479]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f1794-bd4b-4126-afe3-3bd7e052a1ff]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:43 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eaca66-6f97-44f0-8305-930e91f7ce88]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:54:43 user nova-compute[72780]: INFO nova.compute.claims [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Claim successful on node user
Aug 09 00:54:43 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.network.neutron [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:54:44 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.policy [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70e71720a3524b229f3c2c7a327db2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b5ecdb327a4ee98887cd048c08ca0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:54:44 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Creating image(s)
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26330323238346639', 'path': '/dev/sdi'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330323238346639', 'path': '/dev/sdi'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1627471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1627471',id=12,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-50pggjcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:25Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=a76eeaad-0c42-45c7-8351-a3dacdad0574,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.objects.instance [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'pci_devices' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:54:44 user nova-compute[72780]:   <uuid>a76eeaad-0c42-45c7-8351-a3dacdad0574</uuid>
Aug 09 00:54:44 user nova-compute[72780]:   <name>instance-0000000c</name>
Aug 09 00:54:44 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:54:44 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:54:44 user nova-compute[72780]:   <metadata>
Aug 09 00:54:44 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:44 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:54:44 user nova-compute[72780]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1627471</nova:name>
Aug 09 00:54:44 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:54:42</nova:creationTime>
Aug 09 00:54:44 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:54:44 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:44 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:54:44 user nova-compute[72780]:       <nova:owner>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:user uuid="4c93725c6c7e4001b478b1c87d6ba759">tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member</nova:user>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:project uuid="b3d09b1579894f47877a117276c7465f">tempest-ServerBootFromVolumeStableRescueTest-1823004913</nova:project>
Aug 09 00:54:44 user nova-compute[72780]:       </nova:owner>
Aug 09 00:54:44 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:44 user nova-compute[72780]:       <nova:ports>
Aug 09 00:54:44 user nova-compute[72780]:         <nova:port uuid="6fedb901-867a-4ae8-80c4-1da838b3e44e">
Aug 09 00:54:44 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:54:44 user nova-compute[72780]:         </nova:port>
Aug 09 00:54:44 user nova-compute[72780]:       </nova:ports>
Aug 09 00:54:44 user nova-compute[72780]:     </nova:instance>
Aug 09 00:54:44 user nova-compute[72780]:   </metadata>
Aug 09 00:54:44 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:54:44 user nova-compute[72780]:     <system>
Aug 09 00:54:44 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:54:44 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:54:44 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:54:44 user nova-compute[72780]:       <entry name="serial">a76eeaad-0c42-45c7-8351-a3dacdad0574</entry>
Aug 09 00:54:44 user nova-compute[72780]:       <entry name="uuid">a76eeaad-0c42-45c7-8351-a3dacdad0574</entry>
Aug 09 00:54:44 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:54:44 user nova-compute[72780]:     </system>
Aug 09 00:54:44 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:44 user nova-compute[72780]:   <os>
Aug 09 00:54:44 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:54:44 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:54:44 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:54:44 user nova-compute[72780]:   </os>
Aug 09 00:54:44 user nova-compute[72780]:   <features>
Aug 09 00:54:44 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:44 user nova-compute[72780]:     <apic/>
Aug 09 00:54:44 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:54:44 user nova-compute[72780]:   </features>
Aug 09 00:54:44 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:54:44 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:54:44 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:54:44 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:54:44 user nova-compute[72780]:   </clock>
Aug 09 00:54:44 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:54:44 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:54:44 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:54:44 user nova-compute[72780]:   </cpu>
Aug 09 00:54:44 user nova-compute[72780]:   <devices>
Aug 09 00:54:44 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:54:44 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:44 user nova-compute[72780]:       <source dev="/dev/sdi"/>
Aug 09 00:54:44 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:54:44 user nova-compute[72780]:       <serial>d6e76589-9c1b-45b8-8b1b-28007ff9400f</serial>
Aug 09 00:54:44 user nova-compute[72780]:     </disk>
Aug 09 00:54:44 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:54:44 user nova-compute[72780]:       <mac address="fa:16:3e:dd:38:66"/>
Aug 09 00:54:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:54:44 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:54:44 user nova-compute[72780]:       <target dev="tap6fedb901-86"/>
Aug 09 00:54:44 user nova-compute[72780]:     </interface>
Aug 09 00:54:44 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:54:44 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/console.log" append="off"/>
Aug 09 00:54:44 user nova-compute[72780]:     </serial>
Aug 09 00:54:44 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:54:44 user nova-compute[72780]:     <video>
Aug 09 00:54:44 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:54:44 user nova-compute[72780]:     </video>
Aug 09 00:54:44 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:54:44 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:54:44 user nova-compute[72780]:     </rng>
Aug 09 00:54:44 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:54:44 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:54:44 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:54:44 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:44 user nova-compute[72780]:   </devices>
Aug 09 00:54:44 user nova-compute[72780]: </domain>
Aug 09 00:54:44 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1627471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1627471',id=12,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-50pggjcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:25Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=a76eeaad-0c42-45c7-8351-a3dacdad0574,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG os_vif [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fedb901-86, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fedb901-86, col_values=(('external_ids', {'iface-id': '6fedb901-867a-4ae8-80c4-1da838b3e44e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:38:66', 'vm-uuid': 'a76eeaad-0c42-45c7-8351-a3dacdad0574'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:44 user nova-compute[72780]: INFO os_vif [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86')
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk 1073741824" returned: 0 in 0.067s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No VIF found with MAC fa:16:3e:dd:38:66, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Cannot resize image /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.objects.instance [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'migration_context' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:44 user nova-compute[72780]: DEBUG nova.network.neutron [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Successfully created port: 43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:54:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.neutron [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Successfully updated port: 43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.neutron [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-changed-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Refreshing instance network info cache due to event network-changed-43628f21-b02e-42b7-9469-004c6be8b75a. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.neutron [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-e339bdaa-716d-4777-97d8-a9ad0bce2ded req-a5182939-403e-420f-8393-24ea5ce247a8 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e339bdaa-716d-4777-97d8-a9ad0bce2ded req-a5182939-403e-420f-8393-24ea5ce247a8 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e339bdaa-716d-4777-97d8-a9ad0bce2ded req-a5182939-403e-420f-8393-24ea5ce247a8 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e339bdaa-716d-4777-97d8-a9ad0bce2ded req-a5182939-403e-420f-8393-24ea5ce247a8 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-e339bdaa-716d-4777-97d8-a9ad0bce2ded req-a5182939-403e-420f-8393-24ea5ce247a8 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:46 user nova-compute[72780]: WARNING nova.compute.manager [req-e339bdaa-716d-4777-97d8-a9ad0bce2ded req-a5182939-403e-420f-8393-24ea5ce247a8 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state building and task_state spawning.
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.neutron [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance network_info: |[{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.neutron [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Refreshing network info cache for port 43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start _get_guest_xml network_info=[{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:54:46 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:46 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:54:46 user nova-compute[72780]:   <uuid>9f271642-610f-451a-b6e1-159f2cf3523c</uuid>
Aug 09 00:54:46 user nova-compute[72780]:   <name>instance-0000000d</name>
Aug 09 00:54:46 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:54:46 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:54:46 user nova-compute[72780]:   <metadata>
Aug 09 00:54:46 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:54:46 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:54:46 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherB-server-1122386235</nova:name>
Aug 09 00:54:46 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:54:46</nova:creationTime>
Aug 09 00:54:46 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:54:46 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:54:46 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:54:46 user nova-compute[72780]:       <nova:owner>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:user uuid="70e71720a3524b229f3c2c7a327db2c8">tempest-ServerActionsTestOtherB-897270837-project-member</nova:user>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:project uuid="f4b5ecdb327a4ee98887cd048c08ca0d">tempest-ServerActionsTestOtherB-897270837</nova:project>
Aug 09 00:54:46 user nova-compute[72780]:       </nova:owner>
Aug 09 00:54:46 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:54:46 user nova-compute[72780]:       <nova:ports>
Aug 09 00:54:46 user nova-compute[72780]:         <nova:port uuid="43628f21-b02e-42b7-9469-004c6be8b75a">
Aug 09 00:54:46 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 00:54:46 user nova-compute[72780]:         </nova:port>
Aug 09 00:54:46 user nova-compute[72780]:       </nova:ports>
Aug 09 00:54:46 user nova-compute[72780]:     </nova:instance>
Aug 09 00:54:46 user nova-compute[72780]:   </metadata>
Aug 09 00:54:46 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:54:46 user nova-compute[72780]:     <system>
Aug 09 00:54:46 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:54:46 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:54:46 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:54:46 user nova-compute[72780]:       <entry name="serial">9f271642-610f-451a-b6e1-159f2cf3523c</entry>
Aug 09 00:54:46 user nova-compute[72780]:       <entry name="uuid">9f271642-610f-451a-b6e1-159f2cf3523c</entry>
Aug 09 00:54:46 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:54:46 user nova-compute[72780]:     </system>
Aug 09 00:54:46 user nova-compute[72780]:   </sysinfo>
Aug 09 00:54:46 user nova-compute[72780]:   <os>
Aug 09 00:54:46 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:54:46 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:54:46 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:54:46 user nova-compute[72780]:   </os>
Aug 09 00:54:46 user nova-compute[72780]:   <features>
Aug 09 00:54:46 user nova-compute[72780]:     <acpi/>
Aug 09 00:54:46 user nova-compute[72780]:     <apic/>
Aug 09 00:54:46 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:54:46 user nova-compute[72780]:   </features>
Aug 09 00:54:46 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:54:46 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:54:46 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:54:46 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:54:46 user nova-compute[72780]:   </clock>
Aug 09 00:54:46 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:54:46 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:54:46 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:54:46 user nova-compute[72780]:   </cpu>
Aug 09 00:54:46 user nova-compute[72780]:   <devices>
Aug 09 00:54:46 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:54:46 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:54:46 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk"/>
Aug 09 00:54:46 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:54:46 user nova-compute[72780]:     </disk>
Aug 09 00:54:46 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:54:46 user nova-compute[72780]:       <mac address="fa:16:3e:3a:22:77"/>
Aug 09 00:54:46 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:54:46 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:54:46 user nova-compute[72780]:       <target dev="tap43628f21-b0"/>
Aug 09 00:54:46 user nova-compute[72780]:     </interface>
Aug 09 00:54:46 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:54:46 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/console.log" append="off"/>
Aug 09 00:54:46 user nova-compute[72780]:     </serial>
Aug 09 00:54:46 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:54:46 user nova-compute[72780]:     <video>
Aug 09 00:54:46 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:54:46 user nova-compute[72780]:     </video>
Aug 09 00:54:46 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:54:46 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:54:46 user nova-compute[72780]:     </rng>
Aug 09 00:54:46 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:54:46 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:54:46 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:54:46 user nova-compute[72780]:     </memballoon>
Aug 09 00:54:46 user nova-compute[72780]:   </devices>
Aug 09 00:54:46 user nova-compute[72780]: </domain>
Aug 09 00:54:46 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG os_vif [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43628f21-b0, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43628f21-b0, col_values=(('external_ids', {'iface-id': '43628f21-b02e-42b7-9469-004c6be8b75a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:22:77', 'vm-uuid': '9f271642-610f-451a-b6e1-159f2cf3523c'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:46 user nova-compute[72780]: INFO os_vif [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0')
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:54:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No VIF found with MAC fa:16:3e:3a:22:77, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:54:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updated VIF entry in instance network info cache for port 43628f21-b02e-42b7-9469-004c6be8b75a. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:54:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-87b43dc4-fe3d-4745-99a7-95300cc40936 req-7e730b33-c374-43f9-bf70-e268b97f56d2 service nova] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-2cdff642-c571-4140-89e5-818bf884d80e req-2e687671-9fac-4b5d-b57e-90e7a9af0a00 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2cdff642-c571-4140-89e5-818bf884d80e req-2e687671-9fac-4b5d-b57e-90e7a9af0a00 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2cdff642-c571-4140-89e5-818bf884d80e req-2e687671-9fac-4b5d-b57e-90e7a9af0a00 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2cdff642-c571-4140-89e5-818bf884d80e req-2e687671-9fac-4b5d-b57e-90e7a9af0a00 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-2cdff642-c571-4140-89e5-818bf884d80e req-2e687671-9fac-4b5d-b57e-90e7a9af0a00 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:48 user nova-compute[72780]: WARNING nova.compute.manager [req-2cdff642-c571-4140-89e5-818bf884d80e req-2e687671-9fac-4b5d-b57e-90e7a9af0a00 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state building and task_state spawning.
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542488.553514, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Resumed (Lifecycle Event)
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance spawned successfully.
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542488.5550873, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Started (Lifecycle Event)
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 09 00:54:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: INFO nova.compute.manager [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Took 24.82 seconds to build instance.
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24d386eb-195b-413f-b1d8-815f59857270 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.927s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebd4aa80-edbd-4882-9e99-89db2a5f1205', 'serial': 'ebd4aa80-edbd-4882-9e99-89db2a5f1205'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LivMUcfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'f16f9eed-1228-48d9-afed-3b43a3c0593d'}, 'status': 'reserved', 'instance': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f16f9eed-1228-48d9-afed-3b43a3c0593d', 'serial'} {{(pid=72780) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:49 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:49 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:49 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:54:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee45318-99d9-4f6d-9bbc-a84e305a5aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:54:49 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06b8fcf-d2e2-497c-bc5b-c529ea4e9d67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205] added
Aug 09 00:54:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5146bb-a45c-4624-af16-e5443a2d30d6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b17b2e-0c66-437d-ba21-4e235da0ab31]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrazOvRU {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrazOvRU" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7d8b5d-5eff-4c5a-a882-28491964a5c3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrazOvRU'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae4647c-7a9b-4482-b48a-921c6843ae4a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22982b7c-c29a-4e7d-b46c-bc6153ce5f6d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a336a759-5fea-4bf0-9803-05f9b83237b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]
Aug 09 00:54:50 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba273d81-d9fb-4ad5-bf67-c9aa61cab8ef]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d7110-9d2d-4308-bb28-9bf62cd3922b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:50 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b73209-cad3-422b-b3d0-177f06d6be61]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542490.3815756, 9f271642-610f-451a-b6e1-159f2cf3523c => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Resumed (Lifecycle Event)
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance spawned successfully.
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:50 user nova-compute[72780]: WARNING nova.compute.manager [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state building and task_state spawning.
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:50 user nova-compute[72780]: WARNING nova.compute.manager [req-cc358a55-11ad-409d-b2c5-501b915638a8 req-6288b437-607e-4717-aecd-df47477ff959 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state building and task_state spawning.
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542490.3821616, 9f271642-610f-451a-b6e1-159f2cf3523c => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Started (Lifecycle Event)
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 09 00:54:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:54:50 user nova-compute[72780]: INFO nova.compute.manager [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Took 7.31 seconds to build instance.
Aug 09 00:54:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-95a36096-3116-4001-a95a-ee9b68b45811 tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.413s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26331353032633930', 'path': '/dev/sdk'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353032633930', 'path': '/dev/sdk'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:54:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lazy-loading 'flavor' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:54:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 94371840 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 262144000 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 400556032 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 524288000 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 663748608 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 788529152 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-changed-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing instance network info cache due to event network-changed-0134357c-554f-4988-a2d8-54ecd8ab6fc3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] Acquiring lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] Acquired lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Refreshing network info cache for port 0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:54:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 1042284544 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG nova.network.neutron [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updated VIF entry in instance network info cache for port 0134357c-554f-4988-a2d8-54ecd8ab6fc3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG nova.network.neutron [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d1a26212-b018-482c-9b08-b3b173474d84 req-81fdccab-bf31-4b9b-afb0-664766cab5c8 service nova] Releasing lock "refresh_cache-b4bad65f-909e-4a75-a4d0-bf81f89dcc84" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LivMUcfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'f16f9eed-1228-48d9-afed-3b43a3c0593d'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:54:56 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e57efb-a34e-4c36-90c0-d73ab8b37cc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e00578-e59b-44b5-898a-de9b862ddf9c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:54:56 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:54:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac019f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d'): ({'sdj'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Removing single pathed devices sdj {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4fcba-3aee-4370-8b26-bd2b2e3d5cea]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[87222f92-9e08-490b-a48e-f25416891acc]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Flushing IO for device /dev/sdj {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f8a50-8b2b-4b7c-9bc1-ec65d7c5d619]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:54:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef03d5e0-b01c-441c-b8f2-eb7d1e835e61]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] SCSI volumes sdj have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ac28a-10eb-4939-8fb4-944b9845ee18]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[20427ca2-178a-4e40-8559-afbbabcd43ad]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260]
Aug 09 00:54:57 user nova-compute[72780]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d, portal: 172.16.0.220,3260] successful.
Aug 09 00:54:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f16f9eed-1228-48d9-afed-3b43a3c0593d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[28584ac8-6d91-411a-ac6e-d55232084f86]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] <== disconnect_volume: return (348ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebd4aa80-edbd-4882-9e99-89db2a5f1205', 'serial'} {{(pid=72780) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 00:54:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] swap_volume: removing Cinder connection for volume f16f9eed-1228-48d9-afed-3b43a3c0593d {{(pid=72780) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:58 user nova-compute[72780]: INFO nova.compute.manager [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Terminating instance
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] swap_volume: Updating volume f16f9eed-1228-48d9-afed-3b43a3c0593d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "JrazOvRU", "auth_password": "UpcGyujRd4qsPB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "ebd4aa80-edbd-4882-9e99-89db2a5f1205"}, "status": "reserved", "instance": "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e", "attached_at": "", "detached_at": "", "volume_id": "ebd4aa80-edbd-4882-9e99-89db2a5f1205", "serial": "ebd4aa80-edbd-4882-9e99-89db2a5f1205"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ebd4aa80-edbd-4882-9e99-89db2a5f1205', 'no_device': None, 'attachment_id': 'da5a755a-2cd6-4356-a6b3-05a9323e479a'} {{(pid=72780) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8661fb04-8b5b-4ff1-8428-48f133a959d1 tempest-TestVolumeSwap-428756759 tempest-TestVolumeSwap-428756759-project-admin] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.855s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-d30c3de6-77bf-465d-abf0-818520eedd6d req-9a16c843-82ee-44c2-8866-6d45c723ddaf service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d30c3de6-77bf-465d-abf0-818520eedd6d req-9a16c843-82ee-44c2-8866-6d45c723ddaf service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d30c3de6-77bf-465d-abf0-818520eedd6d req-9a16c843-82ee-44c2-8866-6d45c723ddaf service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d30c3de6-77bf-465d-abf0-818520eedd6d req-9a16c843-82ee-44c2-8866-6d45c723ddaf service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-d30c3de6-77bf-465d-abf0-818520eedd6d req-9a16c843-82ee-44c2-8866-6d45c723ddaf service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-d30c3de6-77bf-465d-abf0-818520eedd6d req-9a16c843-82ee-44c2-8866-6d45c723ddaf service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ff05419-46a0-4e7e-ae81-496645ffd5c4 req-e1995df5-7bdf-415c-a834-759d485756db service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ff05419-46a0-4e7e-ae81-496645ffd5c4 req-e1995df5-7bdf-415c-a834-759d485756db service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ff05419-46a0-4e7e-ae81-496645ffd5c4 req-e1995df5-7bdf-415c-a834-759d485756db service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ff05419-46a0-4e7e-ae81-496645ffd5c4 req-e1995df5-7bdf-415c-a834-759d485756db service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ff05419-46a0-4e7e-ae81-496645ffd5c4 req-e1995df5-7bdf-415c-a834-759d485756db service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ff05419-46a0-4e7e-ae81-496645ffd5c4 req-e1995df5-7bdf-415c-a834-759d485756db service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-01821a48-8082-4e27-92f9-2dda759697a9 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-d0f5e0a9-c49f-4fec-be73-3db6fa85f768 req-52e7bd70-f335-49f6-b0aa-6bfb134feda8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d0f5e0a9-c49f-4fec-be73-3db6fa85f768 req-52e7bd70-f335-49f6-b0aa-6bfb134feda8 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d0f5e0a9-c49f-4fec-be73-3db6fa85f768 req-52e7bd70-f335-49f6-b0aa-6bfb134feda8 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d0f5e0a9-c49f-4fec-be73-3db6fa85f768 req-52e7bd70-f335-49f6-b0aa-6bfb134feda8 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-d0f5e0a9-c49f-4fec-be73-3db6fa85f768 req-52e7bd70-f335-49f6-b0aa-6bfb134feda8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:54:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-d0f5e0a9-c49f-4fec-be73-3db6fa85f768 req-52e7bd70-f335-49f6-b0aa-6bfb134feda8 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-dcb49fde-0076-4f71-907e-b1665a019e11 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:54:59 user nova-compute[72780]: INFO nova.compute.manager [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Detaching volume ebd4aa80-edbd-4882-9e99-89db2a5f1205
Aug 09 00:54:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:54:59 user nova-compute[72780]: INFO nova.virt.block_device [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Attempting to driver detach volume ebd4aa80-edbd-4882-9e99-89db2a5f1205 from mountpoint /dev/vdb
Aug 09 00:54:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Attempting to detach device vdb from instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:59 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:59 user nova-compute[72780]:   <source dev="/dev/sdk"/>
Aug 09 00:54:59 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:59 user nova-compute[72780]:   <serial>ebd4aa80-edbd-4882-9e99-89db2a5f1205</serial>
Aug 09 00:54:59 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:54:59 user nova-compute[72780]: </disk>
Aug 09 00:54:59 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:54:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Successfully detached device vdb from instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e from the persistent domain config.
Aug 09 00:54:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:54:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:54:59 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:54:59 user nova-compute[72780]:   <source dev="/dev/sdk"/>
Aug 09 00:54:59 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:54:59 user nova-compute[72780]:   <serial>ebd4aa80-edbd-4882-9e99-89db2a5f1205</serial>
Aug 09 00:54:59 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:54:59 user nova-compute[72780]: </disk>
Aug 09 00:54:59 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Instance destroyed successfully.
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lazy-loading 'resources' on Instance uuid b4bad65f-909e-4a75-a4d0-bf81f89dcc84 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0134357c-55, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c0:20,bridge_name='br-int',has_traffic_filtering=True,id=0134357c-554f-4988-a2d8-54ecd8ab6fc3,network=Network(f47b26e2-9a14-444a-96fa-f4f0a66c1692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0134357c-55')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01821a48-80, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:34:3d,bridge_name='br-int',has_traffic_filtering=True,id=01821a48-8082-4e27-92f9-2dda759697a9,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01821a48-80')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc78b4641-74, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=c78b4641-74a7-4ce9-b168-a3a2fb45f570,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc78b4641-74')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcb49fde-00, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542500.5770364, 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:55:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Successfully detached device vdb from instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e from the live domain config.
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrazOvRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'ebd4aa80-edbd-4882-9e99-89db2a5f1205'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:99:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb49fde-0076-4f71-907e-b1665a019e11,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcb49fde-00')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "72301431-d6e6-4267-93f0-6970ab95454f", "address": "fa:16:3e:56:35:6b", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72301431-d6", "ovs_interfaceid": "72301431-d6e6-4267-93f0-6970ab95454f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72301431-d6, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e8cbc-8421-4b2e-891b-c854aaca0fda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:00 user nova-compute[72780]: WARNING nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-0134357c-554f-4988-a2d8-54ecd8ab6fc3 for instance with vm_state active and task_state deleting.
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:00 user nova-compute[72780]: WARNING nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-c78b4641-74a7-4ce9-b168-a3a2fb45f570 for instance with vm_state active and task_state deleting.
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-79394c84-f680-4f00-9318-31684ee93095 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:00 user nova-compute[72780]: WARNING nova.compute.manager [req-8a76e12f-f1c3-4ed3-b7bc-c2a4354d9b59 req-a426193e-512c-4ee7-b8df-b5bf083e1093 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-79394c84-f680-4f00-9318-31684ee93095 for instance with vm_state active and task_state deleting.
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:35:6b,bridge_name='br-int',has_traffic_filtering=True,id=72301431-d6e6-4267-93f0-6970ab95454f,network=Network(4705723d-0a72-4dab-9e98-35b2bab926dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72301431-d6')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79394c84-f6, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b027856b-9795-40ea-b84c-acae935b50d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:00 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0566ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205'): ({'sdk'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Removing single pathed devices sdk {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:a6:06,bridge_name='br-int',has_traffic_filtering=True,id=79394c84-f680-4f00-9318-31684ee93095,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79394c84-f6')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765148162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765148162',id=10,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmS4FWg4txjm8+bNpDNs/ZiAxC87Rx3SHWc8rxOR27IOVb408cNtWQqLgGFrEuwaNO7B9t/dg7YM/ZwJ7T4nh4NECBK7ElYcdB28fGIx56ypOTpNCe0LM9tHeYb1h1Ong==',key_name='tempest-keypair-77195699',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='030c483139e24282b62330ed55a89250',ramdisk_id='',reservation_id='r-6dryfq89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1856963703',owner_user_name='tempest-TaggedBootDevicesTest-1856963703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcb53e6952f94e518a3b2f877c861e5f',uuid=b4bad65f-909e-4a75-a4d0-bf81f89dcc84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converting VIF {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc661315-cb30-4409-b1f5-7a42755e8c7c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf64598f8-c8, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:00 user nova-compute[72780]: INFO os_vif [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:b8,bridge_name='br-int',has_traffic_filtering=True,id=f64598f8-c8f2-453b-bedd-4606158a87f2,network=Network(c2884dfc-4543-466b-9f96-7a6338b992b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64598f8-c8')
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpyYbODa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b7e78-be1d-4da8-93a2-90a0e9c68402]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Flushing IO for device /dev/sdk {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c12dd-a4d3-4802-b322-ea0684e3b110]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-32a86bbd-66f6-49af-8009-c06aa6c3219d req-f0cd2fc9-374c-449e-a8cb-01466fd91662 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32a86bbd-66f6-49af-8009-c06aa6c3219d req-f0cd2fc9-374c-449e-a8cb-01466fd91662 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32a86bbd-66f6-49af-8009-c06aa6c3219d req-f0cd2fc9-374c-449e-a8cb-01466fd91662 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32a86bbd-66f6-49af-8009-c06aa6c3219d req-f0cd2fc9-374c-449e-a8cb-01466fd91662 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-32a86bbd-66f6-49af-8009-c06aa6c3219d req-f0cd2fc9-374c-449e-a8cb-01466fd91662 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:00 user nova-compute[72780]: WARNING nova.compute.manager [req-32a86bbd-66f6-49af-8009-c06aa6c3219d req-f0cd2fc9-374c-449e-a8cb-01466fd91662 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-01821a48-8082-4e27-92f9-2dda759697a9 for instance with vm_state active and task_state deleting.
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.061s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee75558-5230-40fb-bb9e-52a59db0cdaa]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] SCSI volumes sdk have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d874b-356a-4456-a39d-9d9d7343170c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3cd271-3399-44cc-aa2d-e7184b231e4c]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260]
Aug 09 00:55:00 user nova-compute[72780]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebd4aa80-edbd-4882-9e99-89db2a5f1205 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[febfce2f-1ab5-406f-b3c3-366b2f1529a9]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] <== disconnect_volume: return (422ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.276s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:01 user nova-compute[72780]: WARNING nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-dcb49fde-0076-4f71-907e-b1665a019e11 for instance with vm_state active and task_state deleting.
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-72301431-d6e6-4267-93f0-6970ab95454f for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:01 user nova-compute[72780]: WARNING nova.compute.manager [req-dd53794f-1ab6-4e68-a2c9-be9651011ff6 req-26a435fa-12c1-45a1-a95e-d18799200f72 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-72301431-d6e6-4267-93f0-6970ab95454f for instance with vm_state active and task_state deleting.
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b0c7f-4f99-40ed-8454-863b84b79ba3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1e80c4-c6c5-4482-ba4d-dab8da2c6aeb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac019eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f6780b-6ecf-4a2e-b25d-7791c8bb2539]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26430f3-60f6-4615-a18d-282be4a7ec7b]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b7b279-7174-48b7-bf50-9e579b0c2198]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecde339-0263-4233-8974-31d5833e14d9]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1090462a-a725-4323-ba72-3a8a3270dc5c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15f7db-43a4-47da-b60c-ce070fdd0dfc]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260]
Aug 09 00:55:01 user nova-compute[72780]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23ccf7fd-5226-44c2-98b5-f8f96d10bb23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21880fe-c46d-4e6c-bbda-7dc0301daae7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== disconnect_volume: return (643ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCuGEfca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:01 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d996d7f1-de8f-4731-9381-0a447182b038]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d513214e-7df5-498c-b91a-0c7bc6acad70]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0567520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef37e7c-3fec-41e3-a239-730b2e917acc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dae44c-0c89-45af-a275-71a62cb55ff4]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7718c100-3598-438a-b548-15bf5134c236]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c080072-920e-4ed7-a7f8-629bb0a77d9d]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c110a6-c8ba-4089-b98a-ff4a63e68b4f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0352b1e1-0516-47b8-9e1b-701259fd43cc]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260]
Aug 09 00:55:01 user nova-compute[72780]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48ea1630-08b6-4e9a-9915-a23f15105d34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e9448d-ba0f-43e9-91cd-4d09be4ee342]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== disconnect_volume: return (355ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsrWHZJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:01 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2645c972-731c-4982-9998-8d9cbe8d70e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88c31cb-1944-4f54-baad-2bcc906113c8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:01 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0565360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[31107295-241d-4c40-a9bb-2055a04c134d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[40013641-a26c-434e-a556-b63904a02fde]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cb88d7-f4be-4224-9d13-692b49d62503]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lazy-loading 'flavor' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e4890e-c075-42d0-bc0a-3a5465f854db]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa0250f-0da5-4e7e-86ad-70269ed11f1b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-680df497-e100-4e87-8241-265eafaa4c8a tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.280s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0388ad66-9af2-4878-96e3-2ddd2f28f5be]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260]
Aug 09 00:55:02 user nova-compute[72780]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:02 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112126a1-e6da-4856-828f-0020706660f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f238b5fe-b3b0-4fee-83fc-76a8695bd188]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] <== disconnect_volume: return (336ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:02 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Deleting instance files /opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84_del
Aug 09 00:55:02 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Deletion of /opt/stack/data/nova/instances/b4bad65f-909e-4a75-a4d0-bf81f89dcc84_del complete
Aug 09 00:55:02 user nova-compute[72780]: INFO nova.compute.manager [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Took 4.02 seconds to destroy the instance on the hypervisor.
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-unplugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-unplugged-f64598f8-c8f2-453b-bedd-4606158a87f2 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] Acquiring lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] No waiting events found dispatching network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:02 user nova-compute[72780]: WARNING nova.compute.manager [req-6f068aa8-eb07-4099-99e5-515d59f2b3d8 req-178dc246-3f91-4ddb-a99d-be655fdba4c3 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received unexpected event network-vif-plugged-f64598f8-c8f2-453b-bedd-4606158a87f2 for instance with vm_state active and task_state deleting.
Aug 09 00:55:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-b93ea952-9c33-4f7a-b058-f27898303f4c req-35085d68-6f10-4c75-9313-072a9b60c748 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-deleted-72301431-d6e6-4267-93f0-6970ab95454f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:04 user nova-compute[72780]: INFO nova.compute.manager [req-b93ea952-9c33-4f7a-b058-f27898303f4c req-35085d68-6f10-4c75-9313-072a9b60c748 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Neutron deleted interface 72301431-d6e6-4267-93f0-6970ab95454f; detaching it from the instance and deleting it from the info cache
Aug 09 00:55:04 user nova-compute[72780]: DEBUG nova.network.neutron [req-b93ea952-9c33-4f7a-b058-f27898303f4c req-35085d68-6f10-4c75-9313-072a9b60c748 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79394c84-f680-4f00-9318-31684ee93095", "address": "fa:16:3e:c3:a6:06", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79394c84-f6", "ovs_interfaceid": "79394c84-f680-4f00-9318-31684ee93095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-b93ea952-9c33-4f7a-b058-f27898303f4c req-35085d68-6f10-4c75-9313-072a9b60c748 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Detach interface failed, port_id=72301431-d6e6-4267-93f0-6970ab95454f, reason: Instance b4bad65f-909e-4a75-a4d0-bf81f89dcc84 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:55:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:04 user nova-compute[72780]: INFO nova.compute.manager [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Terminating instance
Aug 09 00:55:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-6264f8a9-078c-4245-8c3a-9a65e1887bf9 req-bc62b455-c879-420b-8126-43bb57267413 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-unplugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6264f8a9-078c-4245-8c3a-9a65e1887bf9 req-bc62b455-c879-420b-8126-43bb57267413 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6264f8a9-078c-4245-8c3a-9a65e1887bf9 req-bc62b455-c879-420b-8126-43bb57267413 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6264f8a9-078c-4245-8c3a-9a65e1887bf9 req-bc62b455-c879-420b-8126-43bb57267413 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-6264f8a9-078c-4245-8c3a-9a65e1887bf9 req-bc62b455-c879-420b-8126-43bb57267413 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-unplugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-6264f8a9-078c-4245-8c3a-9a65e1887bf9 req-bc62b455-c879-420b-8126-43bb57267413 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-unplugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:05 user nova-compute[72780]: INFO nova.compute.manager [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Terminating instance
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-53a0ee39-65a3-4297-89ca-4f0235562ce9 req-079344bd-e870-4d98-9750-e62b6c8250c6 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-vif-unplugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53a0ee39-65a3-4297-89ca-4f0235562ce9 req-079344bd-e870-4d98-9750-e62b6c8250c6 service nova] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53a0ee39-65a3-4297-89ca-4f0235562ce9 req-079344bd-e870-4d98-9750-e62b6c8250c6 service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53a0ee39-65a3-4297-89ca-4f0235562ce9 req-079344bd-e870-4d98-9750-e62b6c8250c6 service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-53a0ee39-65a3-4297-89ca-4f0235562ce9 req-079344bd-e870-4d98-9750-e62b6c8250c6 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] No waiting events found dispatching network-vif-unplugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-53a0ee39-65a3-4297-89ca-4f0235562ce9 req-079344bd-e870-4d98-9750-e62b6c8250c6 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-vif-unplugged-2e61c469-6072-4b94-be42-5333daa7700b for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.compute.manager [req-4bb4576e-2b19-463e-b04b-cb973e5bac70 req-30f0cba6-1780-432f-a285-16411c21dc36 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-deleted-79394c84-f680-4f00-9318-31684ee93095 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.compute.manager [req-4bb4576e-2b19-463e-b04b-cb973e5bac70 req-30f0cba6-1780-432f-a285-16411c21dc36 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Neutron deleted interface 79394c84-f680-4f00-9318-31684ee93095; detaching it from the instance and deleting it from the info cache
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.neutron [req-4bb4576e-2b19-463e-b04b-cb973e5bac70 req-30f0cba6-1780-432f-a285-16411c21dc36 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [{"id": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "address": "fa:16:3e:03:c0:20", "network": {"id": "f47b26e2-9a14-444a-96fa-f4f0a66c1692", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1875939814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0134357c-55", "ovs_interfaceid": "0134357c-554f-4988-a2d8-54ecd8ab6fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01821a48-8082-4e27-92f9-2dda759697a9", "address": "fa:16:3e:06:34:3d", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01821a48-80", "ovs_interfaceid": "01821a48-8082-4e27-92f9-2dda759697a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "address": "fa:16:3e:97:92:7a", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc78b4641-74", "ovs_interfaceid": "c78b4641-74a7-4ce9-b168-a3a2fb45f570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb49fde-0076-4f71-907e-b1665a019e11", "address": "fa:16:3e:39:99:d4", "network": {"id": "4705723d-0a72-4dab-9e98-35b2bab926dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1921878238", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb49fde-00", "ovs_interfaceid": "dcb49fde-0076-4f71-907e-b1665a019e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f64598f8-c8f2-453b-bedd-4606158a87f2", "address": "fa:16:3e:b0:57:b8", "network": {"id": "c2884dfc-4543-466b-9f96-7a6338b992b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-372042062", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "030c483139e24282b62330ed55a89250", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64598f8-c8", "ovs_interfaceid": "f64598f8-c8f2-453b-bedd-4606158a87f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Instance destroyed successfully.
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lazy-loading 'resources' on Instance uuid 78fd796d-5fbe-4352-9df8-7d718bc8bde2 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Instance destroyed successfully.
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lazy-loading 'resources' on Instance uuid 2550fbbd-c0ed-405a-b756-d834138028ad {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.compute.manager [req-4bb4576e-2b19-463e-b04b-cb973e5bac70 req-30f0cba6-1780-432f-a285-16411c21dc36 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Detach interface failed, port_id=79394c84-f680-4f00-9318-31684ee93095, reason: Instance b4bad65f-909e-4a75-a4d0-bf81f89dcc84 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2088268164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2088268164',id=7,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqyHMTZmiawNCOc0e40NkcklnCGcmJYwe4t2XfDQQi0Rxn0lReSS18lRfIFvjJfKwYyaxeJCZuIvjZSwPpKtyJ+sX83MYiaMTV3ITvqhko5SBf2SjXfl8pU70lEQO/swg==',key_name='tempest-keypair-718062648',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a75d1aa47c4c2580cf976ecc9be560',ramdisk_id='',reservation_id='r-4g0xya59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1330377732',owner_user_name='tempest-TaggedAttachmentsTest-1330377732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53f1daff87854ba49adc00cd53ae85f0',uuid=78fd796d-5fbe-4352-9df8-7d718bc8bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converting VIF {"id": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "address": "fa:16:3e:81:35:4c", "network": {"id": "27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-285810556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a75d1aa47c4c2580cf976ecc9be560", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4522d9f-6e", "ovs_interfaceid": "d4522d9f-6eba-45f7-b5df-82d8d36410bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG os_vif [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1130242028',display_name='tempest-VolumesAssistedSnapshotsTest-server-1130242028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1130242028',id=6,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCar5IszY9U0mpdnIq1MvU/uYCggW+PJ7KAWHkPRBCZ7xi6Ajb0E58O5ayUqmT25qB32v3DK5cNRdm0LQAOUXqDNvGNlQJC6TDp3GM3o5wHUBWiP/Z1b+v/fO8rZwDVMg==',key_name='tempest-keypair-811258468',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62122e1504ff4708aa4510646bbccac4',ramdisk_id='',reservation_id='r-d6bhp9fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-724599358',owner_user_name='tempest-VolumesAssistedSnapshotsTest-724599358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00e288c883f430da675cb411b89ea7c',uuid=2550fbbd-c0ed-405a-b756-d834138028ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Converting VIF {"id": "2e61c469-6072-4b94-be42-5333daa7700b", "address": "fa:16:3e:04:a5:a8", "network": {"id": "42c7cdf5-78f9-441e-8622-3547c43ceadb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2047755554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62122e1504ff4708aa4510646bbccac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e61c469-60", "ovs_interfaceid": "2e61c469-6072-4b94-be42-5333daa7700b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG os_vif [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4522d9f-6e, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e61c469-60, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:06 user nova-compute[72780]: INFO os_vif [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:35:4c,bridge_name='br-int',has_traffic_filtering=True,id=d4522d9f-6eba-45f7-b5df-82d8d36410bc,network=Network(27e02b9f-dcb0-4b8a-8ac6-4b8f467bf525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4522d9f-6e')
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Deleting instance files /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2_del
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Deletion of /opt/stack/data/nova/instances/78fd796d-5fbe-4352-9df8-7d718bc8bde2_del complete
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: INFO os_vif [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2e61c469-6072-4b94-be42-5333daa7700b,network=Network(42c7cdf5-78f9-441e-8622-3547c43ceadb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e61c469-60')
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Deleting instance files /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad_del
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Deletion of /opt/stack/data/nova/instances/2550fbbd-c0ed-405a-b756-d834138028ad_del complete
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.compute.manager [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 09 00:55:06 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:55:06 user nova-compute[72780]: INFO nova.compute.manager [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 09 00:55:06 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:07 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Took 5.32 seconds to deallocate network for instance.
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:07 user nova-compute[72780]: WARNING nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with vm_state active and task_state deleting.
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:07 user nova-compute[72780]: WARNING nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with vm_state active and task_state deleting.
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:07 user nova-compute[72780]: WARNING nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with vm_state active and task_state deleting.
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-unplugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-unplugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-49e45645-72cd-466d-9665-b5c94524a53a req-b3f3863d-4f47-4421-99ee-e1cbf401eb84 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-unplugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-ae27a715-60d5-47a9-b823-a9d7924aa45c req-b7bf89f4-7851-454c-a206-b676a186e06e service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ae27a715-60d5-47a9-b823-a9d7924aa45c req-b7bf89f4-7851-454c-a206-b676a186e06e service nova] Acquiring lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ae27a715-60d5-47a9-b823-a9d7924aa45c req-b7bf89f4-7851-454c-a206-b676a186e06e service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ae27a715-60d5-47a9-b823-a9d7924aa45c req-b7bf89f4-7851-454c-a206-b676a186e06e service nova] Lock "2550fbbd-c0ed-405a-b756-d834138028ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-ae27a715-60d5-47a9-b823-a9d7924aa45c req-b7bf89f4-7851-454c-a206-b676a186e06e service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] No waiting events found dispatching network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:07 user nova-compute[72780]: WARNING nova.compute.manager [req-ae27a715-60d5-47a9-b823-a9d7924aa45c req-b7bf89f4-7851-454c-a206-b676a186e06e service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received unexpected event network-vif-plugged-2e61c469-6072-4b94-be42-5333daa7700b for instance with vm_state active and task_state deleting.
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:08 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Took 1.65 seconds to deallocate network for instance.
Aug 09 00:55:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:08 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Took 1.77 seconds to deallocate network for instance.
Aug 09 00:55:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-e527d150-990b-491c-9df7-da4ca770724e req-a8aa55f6-c1b7-4882-a1a6-a0c9f7e32993 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-deleted-0134357c-554f-4988-a2d8-54ecd8ab6fc3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-e527d150-990b-491c-9df7-da4ca770724e req-a8aa55f6-c1b7-4882-a1a6-a0c9f7e32993 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-deleted-dcb49fde-0076-4f71-907e-b1665a019e11 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-e527d150-990b-491c-9df7-da4ca770724e req-a8aa55f6-c1b7-4882-a1a6-a0c9f7e32993 service nova] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Received event network-vif-deleted-f64598f8-c8f2-453b-bedd-4606158a87f2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.388s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:08 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Deleted allocations for instance 78fd796d-5fbe-4352-9df8-7d718bc8bde2
Aug 09 00:55:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7a5c4d50-e31e-4adc-8f30-3f92799476d8 tempest-TaggedAttachmentsTest-1330377732 tempest-TaggedAttachmentsTest-1330377732-project-member] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.047s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:09 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Deleted allocations for instance 2550fbbd-c0ed-405a-b756-d834138028ad
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-638b5a98-00e7-49d0-a25d-cd49cc2aa97e tempest-VolumesAssistedSnapshotsTest-724599358 tempest-VolumesAssistedSnapshotsTest-724599358-project-member] Lock "2550fbbd-c0ed-405a-b756-d834138028ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.798s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'flavor' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] Acquiring lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] Lock "78fd796d-5fbe-4352-9df8-7d718bc8bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] No waiting events found dispatching network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:09 user nova-compute[72780]: WARNING nova.compute.manager [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received unexpected event network-vif-plugged-d4522d9f-6eba-45f7-b5df-82d8d36410bc for instance with vm_state deleted and task_state None.
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2d6f095-721f-49b1-82ae-aa5dd5ad8d19 req-a30c553d-3071-4246-a2bb-d7ae5b8f4b40 service nova] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Received event network-vif-deleted-d4522d9f-6eba-45f7-b5df-82d8d36410bc {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:09 user nova-compute[72780]: INFO nova.compute.manager [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attaching volume 2e7d23de-383e-4a37-81ab-493875aa2da1 to /dev/vdb
Aug 09 00:55:09 user nova-compute[72780]: DEBUG os_brick.utils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6705dcac-4a55-4338-a188-6cea9b1b9c21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ba795-3ab5-482d-939b-f89421ff8a75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff37a8d-7dc7-44d4-bda9-2a8a8b1ae5d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[43270f7d-683a-4c31-b143-e5c4c7af09f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:55:09 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:55:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17a7dff-e5f7-4a1d-8b5d-e1149c61543b]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG os_brick.utils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:09 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating existing volume attachment record: c06e50ac-9169-45ab-aa9f-0464c65fbb6a {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-62474ae2-3d42-4883-89e4-956d04dcd369 req-5f1aa077-0973-4d7d-ac69-f5f18653ba92 service nova] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Received event network-vif-deleted-2e61c469-6072-4b94-be42-5333daa7700b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:55:10 user nova-compute[72780]: INFO nova.compute.manager [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Took 2.59 seconds to detach 3 volumes for instance.
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:10 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Deleted allocations for instance b4bad65f-909e-4a75-a4d0-bf81f89dcc84
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5fb9c437-1eae-43f6-9d2e-f10ded785f08 tempest-TaggedBootDevicesTest-1856963703 tempest-TaggedBootDevicesTest-1856963703-project-member] Lock "b4bad65f-909e-4a75-a4d0-bf81f89dcc84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.490s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:55:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542500.1380856, b4bad65f-909e-4a75-a4d0-bf81f89dcc84 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:15 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] VM Stopped (Lifecycle Event)
Aug 09 00:55:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-26cf61a9-c9d2-48e5-9651-9d332478ce3d None None] [instance: b4bad65f-909e-4a75-a4d0-bf81f89dcc84] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:16 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:55:16 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=25.53497314453125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 0e0fc6f8-5e07-421e-a841-de1c73a7b41e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:55:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:55:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:21 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542506.4369605, 78fd796d-5fbe-4352-9df8-7d718bc8bde2 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:21 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] VM Stopped (Lifecycle Event)
Aug 09 00:55:21 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542506.443312, 2550fbbd-c0ed-405a-b756-d834138028ad => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:21 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] VM Stopped (Lifecycle Event)
Aug 09 00:55:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5f5d6873-3b43-4662-aa52-4b8399b12dc5 None None] [instance: 78fd796d-5fbe-4352-9df8-7d718bc8bde2] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b048df0f-aace-4842-b2d3-70fc3fe77738 None None] [instance: 2550fbbd-c0ed-405a-b756-d834138028ad] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:23 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[40825ea9-0eec-47c3-90b5-87a5a6b173f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:55:23 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a261119-69f1-42d0-b593-5cbf3f3a726c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1] added
Aug 09 00:55:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac6d4c0-f13c-44e0-9931-55f39ba669b4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a78a0c-8418-419a-a447-0ddab8199424]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBbioqWL {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBbioqWL" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[50255e72-5495-4b31-bdac-419f67dd5de3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBbioqWL'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[877ecc10-c3f2-4a2e-b20b-93aa57ce2123]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6c418-03b2-4190-81e1-8ac7ba8c5261]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[db060212-5098-47a9-95eb-399f2cf5de9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]
Aug 09 00:55:23 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79600d-84a0-4b20-8a22-0d4d6e8cd528]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f49473-e391-4960-bd34-6f9a720a85d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:23 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd10d192-91c6-436a-8040-4a5eb0656266]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:55:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23433376366633538', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433376366633538', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'flavor' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:55:24 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:55:24 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:55:24 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:55:24 user nova-compute[72780]:   <serial>2e7d23de-383e-4a37-81ab-493875aa2da1</serial>
Aug 09 00:55:24 user nova-compute[72780]: </disk>
Aug 09 00:55:24 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:55:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No VIF found with MAC fa:16:3e:7b:29:0d, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:55:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5dcf716e-c8d1-4773-b26b-c1245ef2a5af tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.418s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:26 user nova-compute[72780]: INFO nova.compute.manager [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Rebuilding instance
Aug 09 00:55:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'trusted_certs' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'pci_requests' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'pci_devices' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'resources' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'migration_context' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72780) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-efd4e2f4-2847-4829-87a7-e8367617734d req-825b8bd5-fdc6-4451-85fb-23fe68307e5f service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-unplugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-efd4e2f4-2847-4829-87a7-e8367617734d req-825b8bd5-fdc6-4451-85fb-23fe68307e5f service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-efd4e2f4-2847-4829-87a7-e8367617734d req-825b8bd5-fdc6-4451-85fb-23fe68307e5f service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-efd4e2f4-2847-4829-87a7-e8367617734d req-825b8bd5-fdc6-4451-85fb-23fe68307e5f service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-efd4e2f4-2847-4829-87a7-e8367617734d req-825b8bd5-fdc6-4451-85fb-23fe68307e5f service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-unplugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:27 user nova-compute[72780]: WARNING nova.compute.manager [req-efd4e2f4-2847-4829-87a7-e8367617734d req-825b8bd5-fdc6-4451-85fb-23fe68307e5f service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-unplugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state active and task_state rebuilding.
Aug 09 00:55:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance destroyed successfully.
Aug 09 00:55:27 user nova-compute[72780]: INFO nova.compute.manager [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Detaching volume 2e7d23de-383e-4a37-81ab-493875aa2da1
Aug 09 00:55:27 user nova-compute[72780]: INFO nova.virt.block_device [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attempting to driver detach volume 2e7d23de-383e-4a37-81ab-493875aa2da1 from mountpoint /dev/vdb
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Attempting to detach device vdb from instance c57928fc-08eb-407f-9e94-baf32611ac9e from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:55:27 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:55:27 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:55:27 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:55:27 user nova-compute[72780]:   <serial>2e7d23de-383e-4a37-81ab-493875aa2da1</serial>
Aug 09 00:55:27 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:55:27 user nova-compute[72780]: </disk>
Aug 09 00:55:27 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:55:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully detached device vdb from instance c57928fc-08eb-407f-9e94-baf32611ac9e from the persistent domain config.
Aug 09 00:55:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 00:55:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eb5609-ed73-4e0a-9d92-2bb2468286d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f680ac11-21b4-4a3f-859d-1f752a46157d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:28 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0172170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[17969a08-5385-4fef-8d80-594d45a23d3c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1607d84a-3fa0-4fb4-a76e-965efb132abe]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b511130-524a-402c-92c4-3a785016da39]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca24108b-3a62-43d7-ad46-0314bd0d4806]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf506d-24a7-495a-affc-d21786393f34]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.121s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6654826-236f-4a43-a04d-46f639ef3b63]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]
Aug 09 00:55:28 user nova-compute[72780]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c955ffd-1fde-460c-81f2-86a52752e54d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== disconnect_volume: return (352ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance destroyed successfully.
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-699159265',display_name='tempest-ServerActionsTestOtherA-server-2000524521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-699159265',id=2,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-2qcxlys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=c57928fc-08eb-407f-9e94-baf32611ac9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a22dc3-14, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:29 user nova-compute[72780]: INFO os_vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14')
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fbee29-fcf2-4cd9-95b1-dbafa655d247]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8e02e-46f5-45fa-8666-a545b07d1f36]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:29 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac05641f0>, {}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Disconnecting from: [] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== disconnect_volume: return (59ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Deleting instance files /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e_del
Aug 09 00:55:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Deletion of /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e_del complete
Aug 09 00:55:29 user nova-compute[72780]: INFO nova.virt.block_device [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Booting with volume 2e7d23de-383e-4a37-81ab-493875aa2da1 at /dev/vdb
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8759285d-74d2-4aac-9407-8ef7d96ebb39 req-b2751240-ea04-42e7-a22d-4edf5cbed194 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8759285d-74d2-4aac-9407-8ef7d96ebb39 req-b2751240-ea04-42e7-a22d-4edf5cbed194 service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8759285d-74d2-4aac-9407-8ef7d96ebb39 req-b2751240-ea04-42e7-a22d-4edf5cbed194 service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8759285d-74d2-4aac-9407-8ef7d96ebb39 req-b2751240-ea04-42e7-a22d-4edf5cbed194 service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8759285d-74d2-4aac-9407-8ef7d96ebb39 req-b2751240-ea04-42e7-a22d-4edf5cbed194 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:29 user nova-compute[72780]: WARNING nova.compute.manager [req-8759285d-74d2-4aac-9407-8ef7d96ebb39 req-b2751240-ea04-42e7-a22d-4edf5cbed194 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.utils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4786ec-cb93-4063-8c4e-4bfd84072d5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6293a2fc-2c7a-4507-8775-577d8a866a1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca19220-797e-4d6b-b1d9-604c0af4beed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b054a3-aaa3-42ac-a681-a68ded9af137]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:55:29 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:55:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbaf38e-05e9-4f9c-9aa6-b1d4ef61a520]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG os_brick.utils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:29 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating existing volume attachment record: 41633966-127f-4dee-83a8-874038464e6c {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:55:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-changed-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing instance network info cache due to event network-changed-c6cbace6-13de-46ce-a8a1-1992c6f8f091. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] Acquiring lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] Acquired lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.network.neutron [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Refreshing network info cache for port c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'info_cache' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.network.neutron [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updated VIF entry in instance network info cache for port c6cbace6-13de-46ce-a8a1-1992c6f8f091. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.network.neutron [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2d540b28-9938-48d7-94f8-4db889efd570 req-a3b5597c-9618-487a-8a17-831aa01ea237 service nova] Releasing lock "refresh_cache-0e0fc6f8-5e07-421e-a841-de1c73a7b41e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:55:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:55:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance destroyed successfully.
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'resources' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc2b5d5d-b7, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:40 user nova-compute[72780]: INFO os_vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7')
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[906930a9-8bd8-43ae-a5e9-0d9456aafc63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e83b5a-c4c7-415b-b603-379d671a00f3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac06d63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'): ({'sdh'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Removing single pathed devices sdh {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc3b4a1-10a3-486d-9e31-c12d11bfb59b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00beae0c-83eb-490f-b851-f2da1e8563e2]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flushing IO for device /dev/sdh {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a78827c-6ace-46fb-a191-6c11e8b0dd83]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa05276-864b-4045-af7f-d5c874c4103e]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] SCSI volumes sdh have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d753d5f2-d4e3-4449-b2d0-be2994136aea]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6831b00-773b-412e-bf14-58452796ab2a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]
Aug 09 00:55:40 user nova-compute[72780]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee13e91-d30d-4bee-868d-541f34224419]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== disconnect_volume: return (293ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start _get_guest_xml network_info=[{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '1928c3a6-c836-4487-bc21-5eb902fb61fa', 'attached_at': '', 'detached_at': '', 'volume_id': '40ddfc57-e117-427e-8bbd-8afded01812e', 'serial': '40ddfc57-e117-427e-8bbd-8afded01812e'}, 'disk_bus': 'virtio', 'attachment_id': 'f3e33ad0-71ba-402d-b23c-5d541a624cb3', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'numa_topology' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:40 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:55:40 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:40 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a979a1-c8a7-47a2-9d5e-b39a718ad196]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:55:40 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1822007-3a4c-4792-9a6e-709a7c6c86e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e] added
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec919a-739e-4b75-96c9-8113d2d5adb7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca35554-bf9d-4540-ac43-88ddfe6f8686]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHrnjJko {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uHrnjJko" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f83572-b3a5-4ffe-a25f-d89c40e9260b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uHrnjJko'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6141922-0730-4ecc-b9ec-7f42a5ac7c13]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0862eb-9bce-4c02-a255-d28e9de162d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3e28d-9c71-43bb-8d25-0b53a076dea7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]
Aug 09 00:55:40 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c468541-1b30-46c8-af24-a7e7c1b7bc77]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf23c628-568b-4e46-b45d-e4c623368b25]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:40 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1fe743-afe3-481b-a218-4683c59381da]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:55:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:55:41 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Creating image(s)
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:41 user nova-compute[72780]: INFO nova.compute.manager [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Terminating instance
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk 1073741824" returned: 0 in 0.063s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Cannot resize image /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Ensure instance console log exists: /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Start _get_guest_xml network_info=[{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c57928fc-08eb-407f-9e94-baf32611ac9e', 'attached_at': '', 'detached_at': '', 'volume_id': '2e7d23de-383e-4a37-81ab-493875aa2da1', 'serial': '2e7d23de-383e-4a37-81ab-493875aa2da1'}, 'disk_bus': 'virtio', 'attachment_id': '41633966-127f-4dee-83a8-874038464e6c', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:55:41 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 00:55:41 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'vcpu_model' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23365623634666238', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365623634666238', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:41 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:41 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:41 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'pci_devices' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e079b13-8542-4a0b-964b-7917ff6e7313]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:55:41 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-505ef27f-c3b5-4497-9421-154bf84c1f3a req-b1b05785-4bdb-44cc-8415-66eb27b1ef5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-505ef27f-c3b5-4497-9421-154bf84c1f3a req-b1b05785-4bdb-44cc-8415-66eb27b1ef5a service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-505ef27f-c3b5-4497-9421-154bf84c1f3a req-b1b05785-4bdb-44cc-8415-66eb27b1ef5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-505ef27f-c3b5-4497-9421-154bf84c1f3a req-b1b05785-4bdb-44cc-8415-66eb27b1ef5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-505ef27f-c3b5-4497-9421-154bf84c1f3a req-b1b05785-4bdb-44cc-8415-66eb27b1ef5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-505ef27f-c3b5-4497-9421-154bf84c1f3a req-b1b05785-4bdb-44cc-8415-66eb27b1ef5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:55:41 user nova-compute[72780]:   <uuid>1928c3a6-c836-4487-bc21-5eb902fb61fa</uuid>
Aug 09 00:55:41 user nova-compute[72780]:   <name>instance-00000004</name>
Aug 09 00:55:41 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:55:41 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:55:41 user nova-compute[72780]:   <metadata>
Aug 09 00:55:41 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:55:41 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:55:41 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeTestJSON-server-1294527405</nova:name>
Aug 09 00:55:41 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:55:40</nova:creationTime>
Aug 09 00:55:41 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:55:41 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:55:41 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:55:41 user nova-compute[72780]:       <nova:owner>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:user uuid="3f38504b4e824e7ea66ab9e8c56f0b50">tempest-AttachVolumeTestJSON-760573544-project-member</nova:user>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:project uuid="32ce26fa1a3947488856bfd876571471">tempest-AttachVolumeTestJSON-760573544</nova:project>
Aug 09 00:55:41 user nova-compute[72780]:       </nova:owner>
Aug 09 00:55:41 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:55:41 user nova-compute[72780]:       <nova:ports>
Aug 09 00:55:41 user nova-compute[72780]:         <nova:port uuid="fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2">
Aug 09 00:55:41 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 00:55:41 user nova-compute[72780]:         </nova:port>
Aug 09 00:55:41 user nova-compute[72780]:       </nova:ports>
Aug 09 00:55:41 user nova-compute[72780]:     </nova:instance>
Aug 09 00:55:41 user nova-compute[72780]:   </metadata>
Aug 09 00:55:41 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:55:41 user nova-compute[72780]:     <system>
Aug 09 00:55:41 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:55:41 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:55:41 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:55:41 user nova-compute[72780]:       <entry name="serial">1928c3a6-c836-4487-bc21-5eb902fb61fa</entry>
Aug 09 00:55:41 user nova-compute[72780]:       <entry name="uuid">1928c3a6-c836-4487-bc21-5eb902fb61fa</entry>
Aug 09 00:55:41 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:55:41 user nova-compute[72780]:     </system>
Aug 09 00:55:41 user nova-compute[72780]:   </sysinfo>
Aug 09 00:55:41 user nova-compute[72780]:   <os>
Aug 09 00:55:41 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:55:41 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:55:41 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:55:41 user nova-compute[72780]:   </os>
Aug 09 00:55:41 user nova-compute[72780]:   <features>
Aug 09 00:55:41 user nova-compute[72780]:     <acpi/>
Aug 09 00:55:41 user nova-compute[72780]:     <apic/>
Aug 09 00:55:41 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:55:41 user nova-compute[72780]:   </features>
Aug 09 00:55:41 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:55:41 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:55:41 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:55:41 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:55:41 user nova-compute[72780]:   </clock>
Aug 09 00:55:41 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:55:41 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:55:41 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:55:41 user nova-compute[72780]:   </cpu>
Aug 09 00:55:41 user nova-compute[72780]:   <devices>
Aug 09 00:55:41 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:55:41 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:55:41 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk"/>
Aug 09 00:55:41 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:55:41 user nova-compute[72780]:     </disk>
Aug 09 00:55:41 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:55:41 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:55:41 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 00:55:41 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 00:55:41 user nova-compute[72780]:       <serial>40ddfc57-e117-427e-8bbd-8afded01812e</serial>
Aug 09 00:55:41 user nova-compute[72780]:     </disk>
Aug 09 00:55:41 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:55:41 user nova-compute[72780]:       <mac address="fa:16:3e:cb:2c:84"/>
Aug 09 00:55:41 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:55:41 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:55:41 user nova-compute[72780]:       <target dev="tapfc2b5d5d-b7"/>
Aug 09 00:55:41 user nova-compute[72780]:     </interface>
Aug 09 00:55:41 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:55:41 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/console.log" append="off"/>
Aug 09 00:55:41 user nova-compute[72780]:     </serial>
Aug 09 00:55:41 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:55:41 user nova-compute[72780]:     <video>
Aug 09 00:55:41 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:55:41 user nova-compute[72780]:     </video>
Aug 09 00:55:41 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:55:41 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:55:41 user nova-compute[72780]:     </rng>
Aug 09 00:55:41 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:55:41 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:55:41 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:55:41 user nova-compute[72780]:     </memballoon>
Aug 09 00:55:41 user nova-compute[72780]:   </devices>
Aug 09 00:55:41 user nova-compute[72780]: </domain>
Aug 09 00:55:41 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3644fe-f544-4267-8fd0-b7d2424aebec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1] added
Aug 09 00:55:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7d86bc-d50a-4bda-ae7e-2ac9892ef221]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5851f538-9fd6-4e83-af1f-5b27bec78043]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBbioqWL {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBbioqWL" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d56a9-823c-4044-a335-cc7a4ad24a25]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBbioqWL'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-2cf24b76-2458-475c-9c8c-2d7f2404c5e8 req-ae91d638-9d34-4356-9abb-49ba036b22e9 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2cf24b76-2458-475c-9c8c-2d7f2404c5e8 req-ae91d638-9d34-4356-9abb-49ba036b22e9 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2cf24b76-2458-475c-9c8c-2d7f2404c5e8 req-ae91d638-9d34-4356-9abb-49ba036b22e9 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2cf24b76-2458-475c-9c8c-2d7f2404c5e8 req-ae91d638-9d34-4356-9abb-49ba036b22e9 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-2cf24b76-2458-475c-9c8c-2d7f2404c5e8 req-ae91d638-9d34-4356-9abb-49ba036b22e9 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-2cf24b76-2458-475c-9c8c-2d7f2404c5e8 req-ae91d638-9d34-4356-9abb-49ba036b22e9 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f46fe-d996-4d02-a98d-f0019052b5ba]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d9f7e0-aed8-4e48-af3e-6ec9543946cd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c72d9a-7cff-474e-ab1d-2270e3aeb458]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]
Aug 09 00:55:42 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a09223-2eb0-4175-8c55-760ecba3eea8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01da668-8c5d-4830-9f06-04e2b363962a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:42 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.590s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f3de59-7e8a-4292-8e69-38a0a8631ec4]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Cannot resize image /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'migration_context' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542527.7741063, c57928fc-08eb-407f-9e94-baf32611ac9e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:42 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] VM Stopped (Lifecycle Event)
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG os_vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc2b5d5d-b7, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc2b5d5d-b7, col_values=(('external_ids', {'iface-id': 'fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:2c:84', 'vm-uuid': '1928c3a6-c836-4487-bc21-5eb902fb61fa'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-9eb09938-9ab7-43c1-bc91-fb624fb9ce76 req-c51b4763-c80e-478d-9c4a-ce64a1fdad24 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9eb09938-9ab7-43c1-bc91-fb624fb9ce76 req-c51b4763-c80e-478d-9c4a-ce64a1fdad24 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9eb09938-9ab7-43c1-bc91-fb624fb9ce76 req-c51b4763-c80e-478d-9c4a-ce64a1fdad24 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9eb09938-9ab7-43c1-bc91-fb624fb9ce76 req-c51b4763-c80e-478d-9c4a-ce64a1fdad24 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-9eb09938-9ab7-43c1-bc91-fb624fb9ce76 req-c51b4763-c80e-478d-9c4a-ce64a1fdad24 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-9eb09938-9ab7-43c1-bc91-fb624fb9ce76 req-c51b4763-c80e-478d-9c4a-ce64a1fdad24 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1699d75d-bf76-492a-85f4-e586fca4b53a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:42 user nova-compute[72780]: INFO os_vif [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.631s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== connect_volume: return (1632ms) {'type': 'block', 'scsi_wwn': '23433376366633538', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433376366633538', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T00:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-699159265',display_name='tempest-ServerActionsTestOtherA-server-2000524521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-699159265',id=2,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-2qcxlys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=c57928fc-08eb-407f-9e94-baf32611ac9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:55:43 user nova-compute[72780]:   <uuid>c57928fc-08eb-407f-9e94-baf32611ac9e</uuid>
Aug 09 00:55:43 user nova-compute[72780]:   <name>instance-00000002</name>
Aug 09 00:55:43 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:55:43 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:55:43 user nova-compute[72780]:   <metadata>
Aug 09 00:55:43 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:55:43 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:55:43 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherA-server-2000524521</nova:name>
Aug 09 00:55:43 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:55:41</nova:creationTime>
Aug 09 00:55:43 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:55:43 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:55:43 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:55:43 user nova-compute[72780]:       <nova:owner>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:user uuid="8412204a685048a6a787793a7266f085">tempest-ServerActionsTestOtherA-1294078380-project-member</nova:user>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:project uuid="8eb0278ced1640e9a1ab66e5cfcafc8f">tempest-ServerActionsTestOtherA-1294078380</nova:project>
Aug 09 00:55:43 user nova-compute[72780]:       </nova:owner>
Aug 09 00:55:43 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:55:43 user nova-compute[72780]:       <nova:ports>
Aug 09 00:55:43 user nova-compute[72780]:         <nova:port uuid="94a22dc3-1499-42f5-8229-ce152758ea73">
Aug 09 00:55:43 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 00:55:43 user nova-compute[72780]:         </nova:port>
Aug 09 00:55:43 user nova-compute[72780]:       </nova:ports>
Aug 09 00:55:43 user nova-compute[72780]:     </nova:instance>
Aug 09 00:55:43 user nova-compute[72780]:   </metadata>
Aug 09 00:55:43 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:55:43 user nova-compute[72780]:     <system>
Aug 09 00:55:43 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:55:43 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:55:43 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:55:43 user nova-compute[72780]:       <entry name="serial">c57928fc-08eb-407f-9e94-baf32611ac9e</entry>
Aug 09 00:55:43 user nova-compute[72780]:       <entry name="uuid">c57928fc-08eb-407f-9e94-baf32611ac9e</entry>
Aug 09 00:55:43 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:55:43 user nova-compute[72780]:     </system>
Aug 09 00:55:43 user nova-compute[72780]:   </sysinfo>
Aug 09 00:55:43 user nova-compute[72780]:   <os>
Aug 09 00:55:43 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:55:43 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:55:43 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:55:43 user nova-compute[72780]:   </os>
Aug 09 00:55:43 user nova-compute[72780]:   <features>
Aug 09 00:55:43 user nova-compute[72780]:     <acpi/>
Aug 09 00:55:43 user nova-compute[72780]:     <apic/>
Aug 09 00:55:43 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:55:43 user nova-compute[72780]:   </features>
Aug 09 00:55:43 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:55:43 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:55:43 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:55:43 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:55:43 user nova-compute[72780]:   </clock>
Aug 09 00:55:43 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:55:43 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:55:43 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:55:43 user nova-compute[72780]:   </cpu>
Aug 09 00:55:43 user nova-compute[72780]:   <devices>
Aug 09 00:55:43 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:55:43 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:55:43 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk"/>
Aug 09 00:55:43 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:55:43 user nova-compute[72780]:     </disk>
Aug 09 00:55:43 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:55:43 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:55:43 user nova-compute[72780]:       <source dev="/dev/sdc"/>
Aug 09 00:55:43 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 00:55:43 user nova-compute[72780]:       <serial>2e7d23de-383e-4a37-81ab-493875aa2da1</serial>
Aug 09 00:55:43 user nova-compute[72780]:     </disk>
Aug 09 00:55:43 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:55:43 user nova-compute[72780]:       <mac address="fa:16:3e:7b:29:0d"/>
Aug 09 00:55:43 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:55:43 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:55:43 user nova-compute[72780]:       <target dev="tap94a22dc3-14"/>
Aug 09 00:55:43 user nova-compute[72780]:     </interface>
Aug 09 00:55:43 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:55:43 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/console.log" append="off"/>
Aug 09 00:55:43 user nova-compute[72780]:     </serial>
Aug 09 00:55:43 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:55:43 user nova-compute[72780]:     <video>
Aug 09 00:55:43 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:55:43 user nova-compute[72780]:     </video>
Aug 09 00:55:43 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:55:43 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:55:43 user nova-compute[72780]:     </rng>
Aug 09 00:55:43 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:55:43 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:55:43 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:55:43 user nova-compute[72780]:     </memballoon>
Aug 09 00:55:43 user nova-compute[72780]:   </devices>
Aug 09 00:55:43 user nova-compute[72780]: </domain>
Aug 09 00:55:43 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T00:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-699159265',display_name='tempest-ServerActionsTestOtherA-server-2000524521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-699159265',id=2,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-2qcxlys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:55:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=c57928fc-08eb-407f-9e94-baf32611ac9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94a22dc3-14, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94a22dc3-14, col_values=(('external_ids', {'iface-id': '94a22dc3-1499-42f5-8229-ce152758ea73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:29:0d', 'vm-uuid': 'c57928fc-08eb-407f-9e94-baf32611ac9e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Instance destroyed successfully.
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.objects.instance [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lazy-loading 'resources' on Instance uuid 0e0fc6f8-5e07-421e-a841-de1c73a7b41e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6cbace6-13, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No VIF found with MAC fa:16:3e:7b:29:0d, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d8:24,bridge_name='br-int',has_traffic_filtering=True,id=c6cbace6-13de-46ce-a8a1-1992c6f8f091,network=Network(225f850c-4cce-4b3e-a79b-8b18b1d356b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6cbace6-13')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5951788c-c1, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:86:a7,bridge_name='br-int',has_traffic_filtering=True,id=5951788c-c1ce-4412-9d1b-2881f3efcf6d,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5951788c-c1')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap268dcf01-49, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:f7:0b,bridge_name='br-int',has_traffic_filtering=True,id=268dcf01-4949-4ea7-9325-985babb69a79,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap268dcf01-49')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7947d80-59, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=e7947d80-596a-45d5-b72b-b74cbd725e55,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7947d80-59')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap740e63a0-2d, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:90:cc,bridge_name='br-int',has_traffic_filtering=True,id=740e63a0-2dcf-482e-9013-c25eda8ba97c,network=Network(fea20a29-cd59-46f7-a054-b3d1181a334c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740e63a0-2d')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf38f18af-55, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:43 user nova-compute[72780]: WARNING nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-c6cbace6-13de-46ce-a8a1-1992c6f8f091 for instance with vm_state active and task_state deleting.
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-e7947d80-596a-45d5-b72b-b74cbd725e55 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:43 user nova-compute[72780]: WARNING nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-e7947d80-596a-45d5-b72b-b74cbd725e55 for instance with vm_state active and task_state deleting.
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-f38f18af-55a5-47fc-8be0-4924d404eb2e for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:43 user nova-compute[72780]: WARNING nova.compute.manager [req-92a7fa15-fd89-4e2d-a1f1-7f455ec725f0 req-4bb9f5d9-a1ff-4443-bad5-725dd2b85141 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-f38f18af-55a5-47fc-8be0-4924d404eb2e for instance with vm_state active and task_state deleting.
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:43 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=f38f18af-55a5-47fc-8be0-4924d404eb2e,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38f18af-55')
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900174190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900174190',id=9,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKDKQZoFpZEbNFn1WqRNYi4O4IhZ4JoNX5+ysgWuVBjmmXn2KhT5Wgmvfagg2+nQCO+eZaJwezi/XupU2Etc7FOSjWCPz4DAkHovOG1jKN6MXkU1SgWme1HRyB4351kjQ==',key_name='tempest-keypair-1294944307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9858a38f25aa4dd3bbfd1a80ef16b5de',ramdisk_id='',reservation_id='r-s1hbudh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1269375644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1269375644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c57ad9eb9fd945a6916cc31ad2557c0f',uuid=0e0fc6f8-5e07-421e-a841-de1c73a7b41e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converting VIF {"id": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "address": "fa:16:3e:af:6a:9a", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1db11d-23", "ovs_interfaceid": "5c1db11d-23e2-4fce-a4e6-61364225ee37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:43 user nova-compute[72780]: DEBUG os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c1db11d-23, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:44 user nova-compute[72780]: INFO os_vif [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:9a,bridge_name='br-int',has_traffic_filtering=True,id=5c1db11d-23e2-4fce-a4e6-61364225ee37,network=Network(adaba02a-e024-45f1-99f5-5773d4c5cf55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1db11d-23')
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJAUnBGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d54e0d-274f-4e2e-a749-8dfc73b4b01c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e0b25-ed88-4420-ac34-80752d53dbaf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01af520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e'): ({'sde'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Removing single pathed devices sde {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a176f1-3a8e-4fa7-b658-d8a6ba4ec268]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d1c368-2c15-4ab5-b6f8-e427b28aec52]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Flushing IO for device /dev/sde {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-5951788c-c1ce-4412-9d1b-2881f3efcf6d for instance with vm_state active and task_state deleting.
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-268dcf01-4949-4ea7-9325-985babb69a79 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-268dcf01-4949-4ea7-9325-985babb69a79 for instance with vm_state active and task_state deleting.
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-unplugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-unplugged-740e63a0-2dcf-482e-9013-c25eda8ba97c for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING nova.compute.manager [req-9967885d-12fd-4794-a8ae-82753359dcd4 req-aa88dd14-27e0-4b22-a294-b74c9c18dd5a service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-740e63a0-2dcf-482e-9013-c25eda8ba97c for instance with vm_state active and task_state deleting.
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6579b67-f873-4e1f-92d0-bc2b6e29c869]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86abce0-8ffd-4c62-a6cc-0487b8fbd102]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f4a3d-0b01-4d41-b6fc-60403612793c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e307c0e1-37f2-4687-b712-57810540a320]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260]
Aug 09 00:55:44 user nova-compute[72780]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663bf838-36a9-4e8f-bcd1-f24f5223120e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b973236b-a263-49ee-8e97-351490dea290]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== disconnect_volume: return (309ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYqgdpVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[52920ca0-34be-44aa-a1d4-6400bcd803d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e53cb2-9deb-42e2-8add-52c1de9ac505]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac019e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190'): ({'sdf'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Removing single pathed devices sdf {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b44387f-9bc3-4f94-a2ae-91acde6f2de7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb59f2-9f1e-430e-8f85-ab28974dc224]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Flushing IO for device /dev/sdf {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eead8eb-31b8-41ec-95ba-f86f23effa7d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa63ed0-5187-40b8-b6b1-ea20ee737b25]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f94b1f-105c-4070-a081-6527a22db407]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d575b-30b2-4098-94c1-393edc1ea6a8]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260]
Aug 09 00:55:44 user nova-compute[72780]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c18dd1e-b645-4e22-81be-f90ed02a1190 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d05ba5-4eeb-4192-867e-266de3e02725]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== disconnect_volume: return (291ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjfnLpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed90b24-fe48-4637-9177-93ca50274a42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[854416bd-70e6-4a4e-9c46-8a4cb133a3d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:55:44 user nova-compute[72780]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab (non-flash)
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0752170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab'): ({'sdg'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Removing single pathed devices sdg {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f1c97-4b43-4939-80c9-f0775b95137d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c02907-809a-4ad2-a212-d7ce42f19d4e]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Flushing IO for device /dev/sdg {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aea72f-7938-4432-8e09-4f4238b64adb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e8da6e-65a5-4dd5-aa67-63c43b45968d]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] SCSI volumes sdg have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b24626c-5d6e-4d2b-84bd-2661141a2856]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-a62d6364-592d-4010-9686-70fce4f9d94c req-e308394a-5373-4384-9197-d98953ec2e56 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a62d6364-592d-4010-9686-70fce4f9d94c req-e308394a-5373-4384-9197-d98953ec2e56 service nova] Acquiring lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a62d6364-592d-4010-9686-70fce4f9d94c req-e308394a-5373-4384-9197-d98953ec2e56 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a62d6364-592d-4010-9686-70fce4f9d94c req-e308394a-5373-4384-9197-d98953ec2e56 service nova] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-a62d6364-592d-4010-9686-70fce4f9d94c req-e308394a-5373-4384-9197-d98953ec2e56 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] No waiting events found dispatching network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:44 user nova-compute[72780]: WARNING nova.compute.manager [req-a62d6364-592d-4010-9686-70fce4f9d94c req-e308394a-5373-4384-9197-d98953ec2e56 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received unexpected event network-vif-plugged-5c1db11d-23e2-4fce-a4e6-61364225ee37 for instance with vm_state active and task_state deleting.
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5b918-35af-4f90-b6b0-f37576c35a46]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260]
Aug 09 00:55:44 user nova-compute[72780]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab, portal: 172.16.0.220,3260] successful.
Aug 09 00:55:44 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aafb0a0-3c45-47c1-8c19-8233ce92f6ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1506a85f-39e7-4526-b5a1-8969547f56d5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] <== disconnect_volume: return (293ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:55:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:55:44 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Deleting instance files /opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e_del
Aug 09 00:55:44 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Deletion of /opt/stack/data/nova/instances/0e0fc6f8-5e07-421e-a841-de1c73a7b41e_del complete
Aug 09 00:55:45 user nova-compute[72780]: INFO nova.compute.manager [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Took 3.53 seconds to destroy the instance on the hypervisor.
Aug 09 00:55:45 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-a792ac72-b8c0-44cf-9508-381cb016828d req-d00d5da3-46ae-4553-b02f-8454b78a2c1e service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a792ac72-b8c0-44cf-9508-381cb016828d req-d00d5da3-46ae-4553-b02f-8454b78a2c1e service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a792ac72-b8c0-44cf-9508-381cb016828d req-d00d5da3-46ae-4553-b02f-8454b78a2c1e service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a792ac72-b8c0-44cf-9508-381cb016828d req-d00d5da3-46ae-4553-b02f-8454b78a2c1e service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-a792ac72-b8c0-44cf-9508-381cb016828d req-d00d5da3-46ae-4553-b02f-8454b78a2c1e service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:46 user nova-compute[72780]: WARNING nova.compute.manager [req-a792ac72-b8c0-44cf-9508-381cb016828d req-d00d5da3-46ae-4553-b02f-8454b78a2c1e service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 00:55:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:46 user nova-compute[72780]: WARNING nova.compute.manager [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state powering-on.
Aug 09 00:55:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:46 user nova-compute[72780]: WARNING nova.compute.manager [req-6078ce76-0f81-43d1-9e11-395fe1d0664c req-7a7bb74e-f635-4a5b-a45e-d85e3698112f service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state powering-on.
Aug 09 00:55:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:48 user nova-compute[72780]: WARNING nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-deleted-5c1db11d-23e2-4fce-a4e6-61364225ee37 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Neutron deleted interface 5c1db11d-23e2-4fce-a4e6-61364225ee37; detaching it from the instance and deleting it from the info cache
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "address": "fa:16:3e:ea:90:cc", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740e63a0-2d", "ovs_interfaceid": "740e63a0-2dcf-482e-9013-c25eda8ba97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Detach interface failed, port_id=5c1db11d-23e2-4fce-a4e6-61364225ee37, reason: Instance 0e0fc6f8-5e07-421e-a841-de1c73a7b41e could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-deleted-740e63a0-2dcf-482e-9013-c25eda8ba97c {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Neutron deleted interface 740e63a0-2dcf-482e-9013-c25eda8ba97c; detaching it from the instance and deleting it from the info cache
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [{"id": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "address": "fa:16:3e:a1:d8:24", "network": {"id": "225f850c-4cce-4b3e-a79b-8b18b1d356b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-450025604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6cbace6-13", "ovs_interfaceid": "c6cbace6-13de-46ce-a8a1-1992c6f8f091", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "address": "fa:16:3e:6a:86:a7", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5951788c-c1", "ovs_interfaceid": "5951788c-c1ce-4412-9d1b-2881f3efcf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "268dcf01-4949-4ea7-9325-985babb69a79", "address": "fa:16:3e:d4:f7:0b", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap268dcf01-49", "ovs_interfaceid": "268dcf01-4949-4ea7-9325-985babb69a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7947d80-596a-45d5-b72b-b74cbd725e55", "address": "fa:16:3e:0a:d9:49", "network": {"id": "fea20a29-cd59-46f7-a054-b3d1181a334c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1271506284", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7947d80-59", "ovs_interfaceid": "e7947d80-596a-45d5-b72b-b74cbd725e55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "address": "fa:16:3e:f5:35:e9", "network": {"id": "adaba02a-e024-45f1-99f5-5773d4c5cf55", "bridge": "br-int", "label": "tempest-device-tagging-net2-1403120357", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9858a38f25aa4dd3bbfd1a80ef16b5de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38f18af-55", "ovs_interfaceid": "f38f18af-55a5-47fc-8be0-4924d404eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-eee73910-e26a-46d6-a73c-80b45960a69f req-767a77cc-1c49-4993-8cd2-f96bb665d133 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Detach interface failed, port_id=740e63a0-2dcf-482e-9013-c25eda8ba97c, reason: Instance 0e0fc6f8-5e07-421e-a841-de1c73a7b41e could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542548.381739, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Resumed (Lifecycle Event)
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance rebooted successfully.
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8c2690a-a5b4-4ae2-91f2-9bc5926a55fe tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance spawned successfully.
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542548.3910308, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Started (Lifecycle Event)
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542548.4217815, c57928fc-08eb-407f-9e94-baf32611ac9e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] VM Resumed (Lifecycle Event)
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542548.4228368, c57928fc-08eb-407f-9e94-baf32611ac9e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] VM Started (Lifecycle Event)
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:55:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 00:55:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72780) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 00:55:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3137e35-802c-4be5-9fe5-b4ed0b07e51c tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.101s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:49 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:49 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Took 4.74 seconds to deallocate network for instance.
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:50 user nova-compute[72780]: INFO nova.compute.manager [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Terminating instance
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-81532b67-6b17-48ef-aaba-c6c94a430489 req-61f9c0b8-ef6e-4b7e-8504-29feea9c8e10 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-deleted-c6cbace6-13de-46ce-a8a1-1992c6f8f091 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-81532b67-6b17-48ef-aaba-c6c94a430489 req-61f9c0b8-ef6e-4b7e-8504-29feea9c8e10 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-deleted-f38f18af-55a5-47fc-8be0-4924d404eb2e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-81532b67-6b17-48ef-aaba-c6c94a430489 req-61f9c0b8-ef6e-4b7e-8504-29feea9c8e10 service nova] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Received event network-vif-deleted-e7947d80-596a-45d5-b72b-b74cbd725e55 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-be95a837-265b-40db-a8b1-41879e4f5a0a req-b555ec79-f10d-4f8f-b03d-206e7f5f21ac service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-vif-unplugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-be95a837-265b-40db-a8b1-41879e4f5a0a req-b555ec79-f10d-4f8f-b03d-206e7f5f21ac service nova] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-be95a837-265b-40db-a8b1-41879e4f5a0a req-b555ec79-f10d-4f8f-b03d-206e7f5f21ac service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-be95a837-265b-40db-a8b1-41879e4f5a0a req-b555ec79-f10d-4f8f-b03d-206e7f5f21ac service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-be95a837-265b-40db-a8b1-41879e4f5a0a req-b555ec79-f10d-4f8f-b03d-206e7f5f21ac service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] No waiting events found dispatching network-vif-unplugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-be95a837-265b-40db-a8b1-41879e4f5a0a req-b555ec79-f10d-4f8f-b03d-206e7f5f21ac service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-vif-unplugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:55:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Instance destroyed successfully.
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lazy-loading 'resources' on Instance uuid 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:52:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1482642433',display_name='tempest-TestVolumeSwap-server-1482642433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1482642433',id=8,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHMRkHd8JrwJtqelVvRUVsd3PhtR5IAZdP+3qbD8rTXNha46FJFpjLnWwDPKXRdkbKZ7F074TNF4PvpsWD/L/v+RZKqUM86zyOPsOIjG/QSoY7upnU8Qf+IUbBSEY5psw==',key_name='tempest-keypair-855369443',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55fada72a9624d0287b9b9727a85bf6c',ramdisk_id='',reservation_id='r-he2lth62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-893846713',owner_user_name='tempest-TestVolumeSwap-893846713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2a6c9796a24419bbc3efcc6cfe4a9c0',uuid=04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Converting VIF {"id": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "address": "fa:16:3e:5f:87:82", "network": {"id": "5593bbf9-24cf-4985-83c0-d097aa487bd1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-729579757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55fada72a9624d0287b9b9727a85bf6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc6d8b1-c2", "ovs_interfaceid": "4bc6d8b1-c27c-4e16-98c3-53903d83a899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:55:50 user nova-compute[72780]: DEBUG os_vif [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:55:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bc6d8b1-c2, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:55:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:55:51 user nova-compute[72780]: INFO os_vif [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:87:82,bridge_name='br-int',has_traffic_filtering=True,id=4bc6d8b1-c27c-4e16-98c3-53903d83a899,network=Network(5593bbf9-24cf-4985-83c0-d097aa487bd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc6d8b1-c2')
Aug 09 00:55:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Deleting instance files /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e_del
Aug 09 00:55:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Deletion of /opt/stack/data/nova/instances/04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e_del complete
Aug 09 00:55:51 user nova-compute[72780]: INFO nova.compute.manager [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 00:55:51 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:55:51 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:55:51 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:55:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-a4780ff6-b0fe-4b0b-8e5d-08d61fa53e72 req-4d85e067-5b32-470c-a20c-b441c95a5083 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a4780ff6-b0fe-4b0b-8e5d-08d61fa53e72 req-4d85e067-5b32-470c-a20c-b441c95a5083 service nova] Acquiring lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a4780ff6-b0fe-4b0b-8e5d-08d61fa53e72 req-4d85e067-5b32-470c-a20c-b441c95a5083 service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a4780ff6-b0fe-4b0b-8e5d-08d61fa53e72 req-4d85e067-5b32-470c-a20c-b441c95a5083 service nova] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-a4780ff6-b0fe-4b0b-8e5d-08d61fa53e72 req-4d85e067-5b32-470c-a20c-b441c95a5083 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] No waiting events found dispatching network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:55:52 user nova-compute[72780]: WARNING nova.compute.manager [req-a4780ff6-b0fe-4b0b-8e5d-08d61fa53e72 req-4d85e067-5b32-470c-a20c-b441c95a5083 service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received unexpected event network-vif-plugged-4bc6d8b1-c27c-4e16-98c3-53903d83a899 for instance with vm_state active and task_state deleting.
Aug 09 00:55:53 user nova-compute[72780]: INFO nova.compute.manager [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Took 3.25 seconds to detach 3 volumes for instance.
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f3caa9d-c2ee-49a2-9a43-9f0302c657bc req-fb79e9a2-832e-41e6-8345-a4ffc1621abc service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Received event network-vif-deleted-4bc6d8b1-c27c-4e16-98c3-53903d83a899 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:55:53 user nova-compute[72780]: INFO nova.compute.manager [req-8f3caa9d-c2ee-49a2-9a43-9f0302c657bc req-fb79e9a2-832e-41e6-8345-a4ffc1621abc service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Neutron deleted interface 4bc6d8b1-c27c-4e16-98c3-53903d83a899; detaching it from the instance and deleting it from the info cache
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.network.neutron [req-8f3caa9d-c2ee-49a2-9a43-9f0302c657bc req-fb79e9a2-832e-41e6-8345-a4ffc1621abc service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:55:53 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Took 1.97 seconds to deallocate network for instance.
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f3caa9d-c2ee-49a2-9a43-9f0302c657bc req-fb79e9a2-832e-41e6-8345-a4ffc1621abc service nova] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Detach interface failed, port_id=4bc6d8b1-c27c-4e16-98c3-53903d83a899, reason: Instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.320s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:55:53 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Deleted allocations for instance 0e0fc6f8-5e07-421e-a841-de1c73a7b41e
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-249277b8-98c8-4059-a89c-3a92a1f5f276 tempest-TaggedBootDevicesTest_v242-1269375644 tempest-TaggedBootDevicesTest_v242-1269375644-project-member] Lock "0e0fc6f8-5e07-421e-a841-de1c73a7b41e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.182s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:53 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Deleted allocations for instance 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e
Aug 09 00:55:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2afcd09-c683-43f8-abc8-825d076f2709 tempest-TestVolumeSwap-893846713 tempest-TestVolumeSwap-893846713-project-member] Lock "04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.838s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:55:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:55:58 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542543.527356, 0e0fc6f8-5e07-421e-a841-de1c73a7b41e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:55:58 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] VM Stopped (Lifecycle Event)
Aug 09 00:55:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-13f647a8-e48a-4a0f-81f3-69cf7b507c01 None None] [instance: 0e0fc6f8-5e07-421e-a841-de1c73a7b41e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:56:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:05 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542550.9691293, 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:05 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] VM Stopped (Lifecycle Event)
Aug 09 00:56:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c74976d2-ff0b-4890-bb83-7b1529be0cb4 None None] [instance: 04b9cc9a-b78c-4c8f-bc72-98ec6885dd1e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:56:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-changed-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Refreshing instance network info cache due to event network-changed-80ff0d44-4460-40ea-b37a-21d59b3a80da. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] Acquiring lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] Acquired lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Refreshing network info cache for port 80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'flavor' on Instance uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:13 user nova-compute[72780]: INFO nova.compute.manager [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Attaching volume 7832b296-d83d-48b1-910b-65819edce1fa to /dev/vdb
Aug 09 00:56:13 user nova-compute[72780]: DEBUG os_brick.utils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4a64f3-7cf3-4ba0-95dd-d95bb7e2dbc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[61afa652-13bb-4401-bd71-b41c42e6f951]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaecce6-4a25-470e-889f-a3c7e51d0350]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00340a6-6688-4d4f-b863-d4c678fda20c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:56:13 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ece55b-50c3-4d9f-b9c6-29393152d5f1]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG os_brick.utils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating existing volume attachment record: 49da1467-773a-4b90-a8ac-557567f56f33 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updated VIF entry in instance network info cache for port 80ff0d44-4460-40ea-b37a-21d59b3a80da. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating instance_info_cache with network_info: [{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-708333e4-dfd2-42f0-9965-fcba5ab95f8c req-957ec564-7998-4e16-819a-9f569477b90a service nova] Releasing lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:14 user nova-compute[72780]: INFO nova.compute.manager [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Rescuing
Aug 09 00:56:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-772b3aeb-fe35-4d8f-850d-73873f9554ba req-84694250-beb1-4c65-bd6b-a0171b262342 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-772b3aeb-fe35-4d8f-850d-73873f9554ba req-84694250-beb1-4c65-bd6b-a0171b262342 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-772b3aeb-fe35-4d8f-850d-73873f9554ba req-84694250-beb1-4c65-bd6b-a0171b262342 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-772b3aeb-fe35-4d8f-850d-73873f9554ba req-84694250-beb1-4c65-bd6b-a0171b262342 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-772b3aeb-fe35-4d8f-850d-73873f9554ba req-84694250-beb1-4c65-bd6b-a0171b262342 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:16 user nova-compute[72780]: WARNING nova.compute.manager [req-772b3aeb-fe35-4d8f-850d-73873f9554ba req-84694250-beb1-4c65-bd6b-a0171b262342 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state active and task_state rescuing.
Aug 09 00:56:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance destroyed successfully.
Aug 09 00:56:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Attempting a stable device rescue
Aug 09 00:56:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72780) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 00:56:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Creating image(s)
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "/opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'trusted_certs' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "6d07a47c4bc25b29c20f2131ce81643dd68a2f22" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "6d07a47c4bc25b29c20f2131ce81643dd68a2f22" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.017s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 1.236s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.part --force-share --output=json" returned: 0 in 0.169s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG nova.virt.images [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] 211c5dd5-36a7-4d84-8ba1-8dbc7fa31cdf was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.part /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-9cda9f79-f334-4d6c-b3b8-05b5bc04d921 req-bc550283-646d-4977-9b55-e3e81740544e service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9cda9f79-f334-4d6c-b3b8-05b5bc04d921 req-bc550283-646d-4977-9b55-e3e81740544e service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9cda9f79-f334-4d6c-b3b8-05b5bc04d921 req-bc550283-646d-4977-9b55-e3e81740544e service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9cda9f79-f334-4d6c-b3b8-05b5bc04d921 req-bc550283-646d-4977-9b55-e3e81740544e service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-9cda9f79-f334-4d6c-b3b8-05b5bc04d921 req-bc550283-646d-4977-9b55-e3e81740544e service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:18 user nova-compute[72780]: WARNING nova.compute.manager [req-9cda9f79-f334-4d6c-b3b8-05b5bc04d921 req-bc550283-646d-4977-9b55-e3e81740544e service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state active and task_state rescuing.
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.part /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.converted" returned: 0 in 0.519s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "6d07a47c4bc25b29c20f2131ce81643dd68a2f22" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.082s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "6d07a47c4bc25b29c20f2131ce81643dd68a2f22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "6d07a47c4bc25b29c20f2131ce81643dd68a2f22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22 --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22,backing_fmt=raw /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22,backing_fmt=raw /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue" returned: 0 in 0.099s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "6d07a47c4bc25b29c20f2131ce81643dd68a2f22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'migration_context' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Start _get_guest_xml network_info=[{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "vif_mac": "fa:16:3e:dd:38:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '211c5dd5-36a7-4d84-8ba1-8dbc7fa31cdf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a76eeaad-0c42-45c7-8351-a3dacdad0574', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6e76589-9c1b-45b8-8b1b-28007ff9400f', 'serial': 'd6e76589-9c1b-45b8-8b1b-28007ff9400f'}, 'disk_bus': 'virtio', 'attachment_id': '9594dfee-e9d3-432a-a3fb-a9564b0d629f', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'resources' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'numa_topology' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:19 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:19 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'vcpu_model' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:56:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:56:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:56:19 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2227a-1e2d-4707-b808-921c6d8bae88]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RfITxHNB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 00:56:19 user nova-compute[72780]: node.name = iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f
Aug 09 00:56:19 user nova-compute[72780]: node.tpgt = -1
Aug 09 00:56:19 user nova-compute[72780]: node.startup = automatic
Aug 09 00:56:19 user nova-compute[72780]: node.leading_login = No
Aug 09 00:56:19 user nova-compute[72780]: iface.iscsi_ifacename = default
Aug 09 00:56:19 user nova-compute[72780]: iface.net_ifacename = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.ipaddress = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.prefix_len = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.hwaddress = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.transport_name = tcp
Aug 09 00:56:19 user nova-compute[72780]: iface.initiatorname = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.vlan_id = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.vlan_priority = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.vlan_state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.iface_num = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.mtu = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.port = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.bootproto = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.subnet_mask = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.gateway = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_alt_client_id = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_dns = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_learn_iqn = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_vendor_id_state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_vendor_id = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.dhcp_slp_da = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.fragmentation = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.gratuitous_arp = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.incoming_forwarding = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.tos_state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.tos = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.ttl = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.delayed_ack = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.tcp_nagle = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.tcp_wsf_state = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.tcp_wsf = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.tcp_timer_scale = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.tcp_timestamp = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.redirect = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.def_task_mgmt_timeout = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.header_digest = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.data_digest = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.immediate_data = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.initial_r2t = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.data_seq_inorder = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.data_pdu_inorder = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.erl = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.max_receive_data_len = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.first_burst_len = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.max_outstanding_r2t = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.max_burst_len = 0
Aug 09 00:56:19 user nova-compute[72780]: iface.chap_auth = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.bidi_chap = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.strict_login_compliance = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.discovery_auth = <empty>
Aug 09 00:56:19 user nova-compute[72780]: iface.discovery_logout = <empty>
Aug 09 00:56:19 user nova-compute[72780]: node.discovery_address = <empty>
Aug 09 00:56:19 user nova-compute[72780]: node.discovery_port = 0
Aug 09 00:56:19 user nova-compute[72780]: node.discovery_type = static
Aug 09 00:56:19 user nova-compute[72780]: node.session.initial_cmdsn = 0
Aug 09 00:56:19 user nova-compute[72780]: node.session.initial_login_retry_max = 8
Aug 09 00:56:19 user nova-compute[72780]: node.session.xmit_thread_priority = -20
Aug 09 00:56:19 user nova-compute[72780]: node.session.cmds_max = 128
Aug 09 00:56:19 user nova-compute[72780]: node.session.queue_depth = 32
Aug 09 00:56:19 user nova-compute[72780]: node.session.nr_sessions = 1
Aug 09 00:56:19 user nova-compute[72780]: node.session.auth.authmethod = CHAP
Aug 09 00:56:19 user nova-compute[72780]: node.session.auth.username = RfITxHNB
Aug 09 00:56:19 user nova-compute[72780]: node.session.auth.password = ***
Aug 09 00:56:19 user nova-compute[72780]: node.session.auth.username_in = <empty>
Aug 09 00:56:19 user nova-compute[72780]: node.session.auth.password_in = <empty>
Aug 09 00:56:19 user nova-compute[72780]: node.session.auth.chap_algs = MD5
Aug 09 00:56:19 user nova-compute[72780]: node.session.timeo.replacement_timeout = 120
Aug 09 00:56:19 user nova-compute[72780]: node.session.err_timeo.abort_timeout = 15
Aug 09 00:56:19 user nova-compute[72780]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 00:56:19 user nova-compute[72780]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 00:56:19 user nova-compute[72780]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.FastAbort = Yes
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.InitialR2T = No
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.ImmediateData = Yes
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.MaxConnections = 1
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 00:56:19 user nova-compute[72780]: node.session.iscsi.ERL = 0
Aug 09 00:56:19 user nova-compute[72780]: node.session.scan = manual
Aug 09 00:56:19 user nova-compute[72780]: node.session.reopen_max = 0
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].address = 172.16.0.220
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].port = 3260
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].startup = manual
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].tcp.window_size = 524288
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].tcp.type_of_service = 0
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].timeo.logout_timeout = 15
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].timeo.login_timeout = 15
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].timeo.auth_timeout = 45
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].iscsi.DataDigest = None
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].iscsi.IFMarker = No
Aug 09 00:56:19 user nova-compute[72780]: node.conn[0].iscsi.OFMarker = No
Aug 09 00:56:19 user nova-compute[72780]: # END RECORD
Aug 09 00:56:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[79976e3b-9975-4d42-b205-f36a3f9a7a75]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b3152c-b9aa-496a-a7fb-d7494078804c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfITxHNB {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfITxHNB" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01d4833-93e4-4b93-af6f-a1a4e4a119fb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RfITxHNB'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a15b6-694c-4423-9f4e-9a49935a99a1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeab7e7-0de8-4dfb-8a34-cb5be67e13c4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:19 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:19 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:19 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:19 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] HCTL ('40', '0', '0', 0) found on session 15 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5efe6-97d1-438b-946c-46525d88bc1f]: (4, ('0 0 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching for a device in session 15 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.296s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== connect_volume: return (298ms) {'type': 'block', 'scsi_wwn': '26330323238346639', 'path': '/dev/sdi'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330323238346639', 'path': '/dev/sdi'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1627471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1627471',id=12,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:54:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-50pggjcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:54:49Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=a76eeaad-0c42-45c7-8351-a3dacdad0574,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "vif_mac": "fa:16:3e:dd:38:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "vif_mac": "fa:16:3e:dd:38:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'pci_devices' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:56:19 user nova-compute[72780]:   <uuid>a76eeaad-0c42-45c7-8351-a3dacdad0574</uuid>
Aug 09 00:56:19 user nova-compute[72780]:   <name>instance-0000000c</name>
Aug 09 00:56:19 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:56:19 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:56:19 user nova-compute[72780]:   <metadata>
Aug 09 00:56:19 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:56:19 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:56:19 user nova-compute[72780]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1627471</nova:name>
Aug 09 00:56:19 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:56:19</nova:creationTime>
Aug 09 00:56:19 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:56:19 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:56:19 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:56:19 user nova-compute[72780]:       <nova:owner>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:user uuid="4c93725c6c7e4001b478b1c87d6ba759">tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member</nova:user>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:project uuid="b3d09b1579894f47877a117276c7465f">tempest-ServerBootFromVolumeStableRescueTest-1823004913</nova:project>
Aug 09 00:56:19 user nova-compute[72780]:       </nova:owner>
Aug 09 00:56:19 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:56:19 user nova-compute[72780]:       <nova:ports>
Aug 09 00:56:19 user nova-compute[72780]:         <nova:port uuid="6fedb901-867a-4ae8-80c4-1da838b3e44e">
Aug 09 00:56:19 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 00:56:19 user nova-compute[72780]:         </nova:port>
Aug 09 00:56:19 user nova-compute[72780]:       </nova:ports>
Aug 09 00:56:19 user nova-compute[72780]:     </nova:instance>
Aug 09 00:56:19 user nova-compute[72780]:   </metadata>
Aug 09 00:56:19 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:56:19 user nova-compute[72780]:     <system>
Aug 09 00:56:19 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:56:19 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:56:19 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:56:19 user nova-compute[72780]:       <entry name="serial">a76eeaad-0c42-45c7-8351-a3dacdad0574</entry>
Aug 09 00:56:19 user nova-compute[72780]:       <entry name="uuid">a76eeaad-0c42-45c7-8351-a3dacdad0574</entry>
Aug 09 00:56:19 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:56:19 user nova-compute[72780]:     </system>
Aug 09 00:56:19 user nova-compute[72780]:   </sysinfo>
Aug 09 00:56:19 user nova-compute[72780]:   <os>
Aug 09 00:56:19 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:56:19 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:56:19 user nova-compute[72780]:   </os>
Aug 09 00:56:19 user nova-compute[72780]:   <features>
Aug 09 00:56:19 user nova-compute[72780]:     <acpi/>
Aug 09 00:56:19 user nova-compute[72780]:     <apic/>
Aug 09 00:56:19 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:56:19 user nova-compute[72780]:   </features>
Aug 09 00:56:19 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:56:19 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:56:19 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:56:19 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:56:19 user nova-compute[72780]:   </clock>
Aug 09 00:56:19 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:56:19 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:56:19 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:56:19 user nova-compute[72780]:   </cpu>
Aug 09 00:56:19 user nova-compute[72780]:   <devices>
Aug 09 00:56:19 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:56:19 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:56:19 user nova-compute[72780]:       <source dev="/dev/sdi"/>
Aug 09 00:56:19 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:56:19 user nova-compute[72780]:       <serial>d6e76589-9c1b-45b8-8b1b-28007ff9400f</serial>
Aug 09 00:56:19 user nova-compute[72780]:     </disk>
Aug 09 00:56:19 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:56:19 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:56:19 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue"/>
Aug 09 00:56:19 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 00:56:19 user nova-compute[72780]:       <boot order="1"/>
Aug 09 00:56:19 user nova-compute[72780]:     </disk>
Aug 09 00:56:19 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:56:19 user nova-compute[72780]:       <mac address="fa:16:3e:dd:38:66"/>
Aug 09 00:56:19 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:56:19 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:56:19 user nova-compute[72780]:       <target dev="tap6fedb901-86"/>
Aug 09 00:56:19 user nova-compute[72780]:     </interface>
Aug 09 00:56:19 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:56:19 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/console.log" append="off"/>
Aug 09 00:56:19 user nova-compute[72780]:     </serial>
Aug 09 00:56:19 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:56:19 user nova-compute[72780]:     <video>
Aug 09 00:56:19 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:56:19 user nova-compute[72780]:     </video>
Aug 09 00:56:19 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:56:19 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:56:19 user nova-compute[72780]:     </rng>
Aug 09 00:56:19 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:56:19 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:56:19 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:56:19 user nova-compute[72780]:     </memballoon>
Aug 09 00:56:19 user nova-compute[72780]:   </devices>
Aug 09 00:56:19 user nova-compute[72780]: </domain>
Aug 09 00:56:19 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:56:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance destroyed successfully.
Aug 09 00:56:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.547378540039062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No VIF found with MAC fa:16:3e:dd:38:66, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:56:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-5b11044b-1400-4556-badf-6c45bfadb4b2 req-15df1e9d-ff12-4928-a347-8f5e1f453e2e service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5b11044b-1400-4556-badf-6c45bfadb4b2 req-15df1e9d-ff12-4928-a347-8f5e1f453e2e service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5b11044b-1400-4556-badf-6c45bfadb4b2 req-15df1e9d-ff12-4928-a347-8f5e1f453e2e service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5b11044b-1400-4556-badf-6c45bfadb4b2 req-15df1e9d-ff12-4928-a347-8f5e1f453e2e service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-5b11044b-1400-4556-badf-6c45bfadb4b2 req-15df1e9d-ff12-4928-a347-8f5e1f453e2e service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:22 user nova-compute[72780]: WARNING nova.compute.manager [req-5b11044b-1400-4556-badf-6c45bfadb4b2 req-15df1e9d-ff12-4928-a347-8f5e1f453e2e service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state active and task_state rescuing.
Aug 09 00:56:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGnHEARm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:56:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:56:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:56:23 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505b23c-770b-4b3d-8558-a3cec7b1ed03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:56:23 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a67776-0a0f-4d7d-b352-f611b0e39647]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa] added
Aug 09 00:56:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9177ef0-e3c6-46fd-814b-4e9c84fc9b43]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62afb62-c8c9-45bc-91f7-aa88c1f87629]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGnHEARm {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGnHEARm" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ba2be-1648-4e73-a62c-6c3c1e451141]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qGnHEARm'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18328e20-d117-499b-9534-3dcb9d783bf1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2736f-97eb-4645-aa5a-81eb9a79410d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75772bc-4bc7-465a-9865-084710ed8c9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260]
Aug 09 00:56:23 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260] successful.
Aug 09 00:56:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90b7355-3f67-49cb-ba9a-d61fbf7ce9e0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c58640c-70fb-4113-b20f-f9b2bc34e4ac]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa (non-flash)
Aug 09 00:56:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:23 user nova-compute[72780]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa (non-flash)
Aug 09 00:56:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5090410-e786-4c86-ad7c-98d2c03befcc]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-b8d326fa-2c35-440f-aece-d257a33fb95a req-a839676d-bbc9-40b3-b6a3-aa4f28322908 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b8d326fa-2c35-440f-aece-d257a33fb95a req-a839676d-bbc9-40b3-b6a3-aa4f28322908 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b8d326fa-2c35-440f-aece-d257a33fb95a req-a839676d-bbc9-40b3-b6a3-aa4f28322908 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b8d326fa-2c35-440f-aece-d257a33fb95a req-a839676d-bbc9-40b3-b6a3-aa4f28322908 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-b8d326fa-2c35-440f-aece-d257a33fb95a req-a839676d-bbc9-40b3-b6a3-aa4f28322908 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:24 user nova-compute[72780]: WARNING nova.compute.manager [req-b8d326fa-2c35-440f-aece-d257a33fb95a req-a839676d-bbc9-40b3-b6a3-aa4f28322908 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state active and task_state rescuing.
Aug 09 00:56:24 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGnHEARm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26436653137653563', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436653137653563', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for a76eeaad-0c42-45c7-8351-a3dacdad0574 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542584.7378545, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Resumed (Lifecycle Event)
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-68a9a93e-4cbd-4ceb-b877-26d131597fa3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'flavor' on Instance uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:56:24 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:56:24 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 00:56:24 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:56:24 user nova-compute[72780]:   <serial>7832b296-d83d-48b1-910b-65819edce1fa</serial>
Aug 09 00:56:24 user nova-compute[72780]: </disk>
Aug 09 00:56:24 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:56:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542584.7392604, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Started (Lifecycle Event)
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:56:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:56:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:56:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No VIF found with MAC fa:16:3e:45:32:bd, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:56:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cbf19e5-0b5d-4984-a8eb-f16d2cc13092 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.440s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:28 user nova-compute[72780]: INFO nova.compute.manager [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Detaching volume 7832b296-d83d-48b1-910b-65819edce1fa
Aug 09 00:56:29 user nova-compute[72780]: INFO nova.virt.block_device [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Attempting to driver detach volume 7832b296-d83d-48b1-910b-65819edce1fa from mountpoint /dev/vdb
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Attempting to detach device vdb from instance abc4a45e-2b7e-4038-9e67-a16a419e43bb from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:56:29 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:56:29 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 00:56:29 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:56:29 user nova-compute[72780]:   <serial>7832b296-d83d-48b1-910b-65819edce1fa</serial>
Aug 09 00:56:29 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:56:29 user nova-compute[72780]: </disk>
Aug 09 00:56:29 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:56:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully detached device vdb from instance abc4a45e-2b7e-4038-9e67-a16a419e43bb from the persistent domain config.
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance abc4a45e-2b7e-4038-9e67-a16a419e43bb from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:56:29 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:56:29 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 00:56:29 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:56:29 user nova-compute[72780]:   <serial>7832b296-d83d-48b1-910b-65819edce1fa</serial>
Aug 09 00:56:29 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:56:29 user nova-compute[72780]: </disk>
Aug 09 00:56:29 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542589.6062121, abc4a45e-2b7e-4038-9e67-a16a419e43bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:56:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully detached device vdb from instance abc4a45e-2b7e-4038-9e67-a16a419e43bb from the live domain config.
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGnHEARm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:56:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[27137b89-f640-43d2-940d-eccd2700966f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[74746274-1856-4465-a57e-de661cc51228]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:29 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:29 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:29 user nova-compute[72780]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa (non-flash)
Aug 09 00:56:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:56:29 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:56:29 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:56:29 user nova-compute[72780]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa (non-flash)
Aug 09 00:56:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0566710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d81bc5-42ed-4fb9-bbb6-1c2d4a6d37ae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ada7cb8-7a55-4c29-9a89-5c142d7b8086]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc56aac-427b-4f3a-9fe5-6c0203edc698]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e680658-4383-4c77-a363-efb234903781]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4592f73-ccdd-4b39-bda8-24318cbb1a48]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[45827d63-5183-4704-a887-5a588f385d6f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260]
Aug 09 00:56:29 user nova-compute[72780]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa, portal: 172.16.0.220,3260] successful.
Aug 09 00:56:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7832b296-d83d-48b1-910b-65819edce1fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[29651e02-3184-4d36-930c-99d4dac0ec8b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] <== disconnect_volume: return (347ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:56:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:56:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:30 user nova-compute[72780]: DEBUG nova.objects.instance [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'flavor' on Instance uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-54802d69-50a5-4d6d-85d1-f273c364d9d1 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:56:32 user nova-compute[72780]: INFO nova.compute.claims [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Claim successful on node user
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:56:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.policy [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee86238cbadd465a8d45b72b20b8f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fde5f8ef464f538a9dc70257e30863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:56:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Creating image(s)
Aug 09 00:56:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "/opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "/opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "/opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.191s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk 1073741824" returned: 0 in 0.068s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.178s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Cannot resize image /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'migration_context' on Instance uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Ensure instance console log exists: /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:34 user nova-compute[72780]: DEBUG nova.network.neutron [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Successfully created port: adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Successfully updated port: adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquired lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-changed-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Refreshing instance network info cache due to event network-changed-adfb9c3d-dc70-4459-bb67-7456bb6281ea. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] Acquiring lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Updating instance_info_cache with network_info: [{"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Releasing lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Instance network_info: |[{"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] Acquired lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.neutron [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Refreshing network info cache for port adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Start _get_guest_xml network_info=[{"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:56:35 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:35 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1520795590',display_name='tempest-VolumesAdminNegativeTest-server-1520795590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1520795590',id=14,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS2ZzAuGtt11hXvPMmvbQLPCZf0Xb9DnF6T3WXNF4XRM4zWQwZl/l5whuhF4UcJaCkbiEqqDlU/85b57PVKMj7Pbl9Hqli9wZz8/MGW7ssNI2lIRFdOMmL2WsQX6iXDjw==',key_name='tempest-keypair-161214364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1fde5f8ef464f538a9dc70257e30863',ramdisk_id='',reservation_id='r-h1p5h9m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-347119394',owner_user_name='tempest-VolumesAdminNegativeTest-347119394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee86238cbadd465a8d45b72b20b8f50d',uuid=deec36f5-a323-4595-b87a-abc995824040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converting VIF {"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.objects.instance [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'pci_devices' on Instance uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:56:35 user nova-compute[72780]:   <uuid>deec36f5-a323-4595-b87a-abc995824040</uuid>
Aug 09 00:56:35 user nova-compute[72780]:   <name>instance-0000000e</name>
Aug 09 00:56:35 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:56:35 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:56:35 user nova-compute[72780]:   <metadata>
Aug 09 00:56:35 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:56:35 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:56:35 user nova-compute[72780]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1520795590</nova:name>
Aug 09 00:56:35 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:56:35</nova:creationTime>
Aug 09 00:56:35 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:56:35 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:56:35 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:56:35 user nova-compute[72780]:       <nova:owner>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:user uuid="ee86238cbadd465a8d45b72b20b8f50d">tempest-VolumesAdminNegativeTest-347119394-project-member</nova:user>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:project uuid="c1fde5f8ef464f538a9dc70257e30863">tempest-VolumesAdminNegativeTest-347119394</nova:project>
Aug 09 00:56:35 user nova-compute[72780]:       </nova:owner>
Aug 09 00:56:35 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:56:35 user nova-compute[72780]:       <nova:ports>
Aug 09 00:56:35 user nova-compute[72780]:         <nova:port uuid="adfb9c3d-dc70-4459-bb67-7456bb6281ea">
Aug 09 00:56:35 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 00:56:35 user nova-compute[72780]:         </nova:port>
Aug 09 00:56:35 user nova-compute[72780]:       </nova:ports>
Aug 09 00:56:35 user nova-compute[72780]:     </nova:instance>
Aug 09 00:56:35 user nova-compute[72780]:   </metadata>
Aug 09 00:56:35 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:56:35 user nova-compute[72780]:     <system>
Aug 09 00:56:35 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:56:35 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:56:35 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:56:35 user nova-compute[72780]:       <entry name="serial">deec36f5-a323-4595-b87a-abc995824040</entry>
Aug 09 00:56:35 user nova-compute[72780]:       <entry name="uuid">deec36f5-a323-4595-b87a-abc995824040</entry>
Aug 09 00:56:35 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:56:35 user nova-compute[72780]:     </system>
Aug 09 00:56:35 user nova-compute[72780]:   </sysinfo>
Aug 09 00:56:35 user nova-compute[72780]:   <os>
Aug 09 00:56:35 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:56:35 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:56:35 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:56:35 user nova-compute[72780]:   </os>
Aug 09 00:56:35 user nova-compute[72780]:   <features>
Aug 09 00:56:35 user nova-compute[72780]:     <acpi/>
Aug 09 00:56:35 user nova-compute[72780]:     <apic/>
Aug 09 00:56:35 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:56:35 user nova-compute[72780]:   </features>
Aug 09 00:56:35 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:56:35 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:56:35 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:56:35 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:56:35 user nova-compute[72780]:   </clock>
Aug 09 00:56:35 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:56:35 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:56:35 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:56:35 user nova-compute[72780]:   </cpu>
Aug 09 00:56:35 user nova-compute[72780]:   <devices>
Aug 09 00:56:35 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:56:35 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:56:35 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk"/>
Aug 09 00:56:35 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:56:35 user nova-compute[72780]:     </disk>
Aug 09 00:56:35 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:56:35 user nova-compute[72780]:       <mac address="fa:16:3e:a6:68:ec"/>
Aug 09 00:56:35 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:56:35 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:56:35 user nova-compute[72780]:       <target dev="tapadfb9c3d-dc"/>
Aug 09 00:56:35 user nova-compute[72780]:     </interface>
Aug 09 00:56:35 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:56:35 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/console.log" append="off"/>
Aug 09 00:56:35 user nova-compute[72780]:     </serial>
Aug 09 00:56:35 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:56:35 user nova-compute[72780]:     <video>
Aug 09 00:56:35 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:56:35 user nova-compute[72780]:     </video>
Aug 09 00:56:35 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:56:35 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:56:35 user nova-compute[72780]:     </rng>
Aug 09 00:56:35 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:56:35 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:56:35 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:56:35 user nova-compute[72780]:     </memballoon>
Aug 09 00:56:35 user nova-compute[72780]:   </devices>
Aug 09 00:56:35 user nova-compute[72780]: </domain>
Aug 09 00:56:35 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1520795590',display_name='tempest-VolumesAdminNegativeTest-server-1520795590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1520795590',id=14,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS2ZzAuGtt11hXvPMmvbQLPCZf0Xb9DnF6T3WXNF4XRM4zWQwZl/l5whuhF4UcJaCkbiEqqDlU/85b57PVKMj7Pbl9Hqli9wZz8/MGW7ssNI2lIRFdOMmL2WsQX6iXDjw==',key_name='tempest-keypair-161214364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1fde5f8ef464f538a9dc70257e30863',ramdisk_id='',reservation_id='r-h1p5h9m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-347119394',owner_user_name='tempest-VolumesAdminNegativeTest-347119394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:56:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee86238cbadd465a8d45b72b20b8f50d',uuid=deec36f5-a323-4595-b87a-abc995824040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converting VIF {"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG os_vif [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadfb9c3d-dc, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadfb9c3d-dc, col_values=(('external_ids', {'iface-id': 'adfb9c3d-dc70-4459-bb67-7456bb6281ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:68:ec', 'vm-uuid': 'deec36f5-a323-4595-b87a-abc995824040'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:56:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:35 user nova-compute[72780]: INFO os_vif [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc')
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No VIF found with MAC fa:16:3e:a6:68:ec, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-changed-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Refreshing instance network info cache due to event network-changed-43628f21-b02e-42b7-9469-004c6be8b75a. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.network.neutron [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Refreshing network info cache for port 43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.network.neutron [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Updated VIF entry in instance network info cache for port adfb9c3d-dc70-4459-bb67-7456bb6281ea. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG nova.network.neutron [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Updating instance_info_cache with network_info: [{"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b99dc288-deef-46ca-8042-47715b9c143a req-b1044885-d1a8-40b0-8c72-958a0adb06a0 service nova] Releasing lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG nova.network.neutron [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updated VIF entry in instance network info cache for port 43628f21-b02e-42b7-9469-004c6be8b75a. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG nova.network.neutron [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-14e1adc5-37a8-4cf7-85e5-9ac460886e76 req-1e4f20e6-1a94-49d7-b6ca-7192e462698c service nova] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-39fc409a-4b85-46c0-be7f-5939413117c9 req-5d5af13a-460e-4853-8bb8-ef7fb50b042d service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-39fc409a-4b85-46c0-be7f-5939413117c9 req-5d5af13a-460e-4853-8bb8-ef7fb50b042d service nova] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-39fc409a-4b85-46c0-be7f-5939413117c9 req-5d5af13a-460e-4853-8bb8-ef7fb50b042d service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-39fc409a-4b85-46c0-be7f-5939413117c9 req-5d5af13a-460e-4853-8bb8-ef7fb50b042d service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-39fc409a-4b85-46c0-be7f-5939413117c9 req-5d5af13a-460e-4853-8bb8-ef7fb50b042d service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] No waiting events found dispatching network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:38 user nova-compute[72780]: WARNING nova.compute.manager [req-39fc409a-4b85-46c0-be7f-5939413117c9 req-5d5af13a-460e-4853-8bb8-ef7fb50b042d service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received unexpected event network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea for instance with vm_state building and task_state spawning.
Aug 09 00:56:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542600.2218804, deec36f5-a323-4595-b87a-abc995824040 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] VM Resumed (Lifecycle Event)
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: deec36f5-a323-4595-b87a-abc995824040] Instance spawned successfully.
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542600.222729, deec36f5-a323-4595-b87a-abc995824040 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] VM Started (Lifecycle Event)
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-f1ed4fc1-df32-48c7-8a3d-6435acf7f53b req-fb038c66-ceac-4f86-8c93-467d35215d0f service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f1ed4fc1-df32-48c7-8a3d-6435acf7f53b req-fb038c66-ceac-4f86-8c93-467d35215d0f service nova] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f1ed4fc1-df32-48c7-8a3d-6435acf7f53b req-fb038c66-ceac-4f86-8c93-467d35215d0f service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f1ed4fc1-df32-48c7-8a3d-6435acf7f53b req-fb038c66-ceac-4f86-8c93-467d35215d0f service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-f1ed4fc1-df32-48c7-8a3d-6435acf7f53b req-fb038c66-ceac-4f86-8c93-467d35215d0f service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] No waiting events found dispatching network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:40 user nova-compute[72780]: WARNING nova.compute.manager [req-f1ed4fc1-df32-48c7-8a3d-6435acf7f53b req-fb038c66-ceac-4f86-8c93-467d35215d0f service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received unexpected event network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea for instance with vm_state building and task_state spawning.
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Took 7.41 seconds to spawn the instance on the hypervisor.
Aug 09 00:56:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:40 user nova-compute[72780]: INFO nova.compute.manager [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Took 8.39 seconds to build instance.
Aug 09 00:56:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-2be87e1d-750c-44c8-9c61-7472676e0b67 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.498s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:56:47 user nova-compute[72780]: INFO nova.compute.claims [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Claim successful on node user
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:56:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:56:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:56:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Creating image(s)
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "/opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "/opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "/opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.policy [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2ffd7b5f4a244d3a1f8105abd22ef1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffaebd4a6344e3ea94485cc7d566c0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.161s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk 1073741824" returned: 0 in 0.063s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.166s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.network.neutron [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Successfully created port: 22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Cannot resize image /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lazy-loading 'migration_context' on Instance uuid b907b883-5bd6-4387-bc37-a15bff3c00ff {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Ensure instance console log exists: /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Successfully updated port: 22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "refresh_cache-b907b883-5bd6-4387-bc37-a15bff3c00ff" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquired lock "refresh_cache-b907b883-5bd6-4387-bc37-a15bff3c00ff" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-changed-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Refreshing instance network info cache due to event network-changed-22385121-9085-4dc4-a154-60efde23a647. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:56:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] Acquiring lock "refresh_cache-b907b883-5bd6-4387-bc37-a15bff3c00ff" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.neutron [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Updating instance_info_cache with network_info: [{"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Releasing lock "refresh_cache-b907b883-5bd6-4387-bc37-a15bff3c00ff" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Instance network_info: |[{"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] Acquired lock "refresh_cache-b907b883-5bd6-4387-bc37-a15bff3c00ff" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.neutron [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Refreshing network info cache for port 22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Start _get_guest_xml network_info=[{"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:56:50 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:50 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1652917464',display_name='tempest-VolumesActionsTest-instance-1652917464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1652917464',id=15,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ffaebd4a6344e3ea94485cc7d566c0e',ramdisk_id='',reservation_id='r-rno5bscc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-952031033',owner_user_name='tempest-VolumesActionsTest-952031033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:56:48Z,user_data=None,user_id='e2ffd7b5f4a244d3a1f8105abd22ef1d',uuid=b907b883-5bd6-4387-bc37-a15bff3c00ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Converting VIF {"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.objects.instance [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lazy-loading 'pci_devices' on Instance uuid b907b883-5bd6-4387-bc37-a15bff3c00ff {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:56:50 user nova-compute[72780]:   <uuid>b907b883-5bd6-4387-bc37-a15bff3c00ff</uuid>
Aug 09 00:56:50 user nova-compute[72780]:   <name>instance-0000000f</name>
Aug 09 00:56:50 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:56:50 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:56:50 user nova-compute[72780]:   <metadata>
Aug 09 00:56:50 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:56:50 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:56:50 user nova-compute[72780]:       <nova:name>tempest-VolumesActionsTest-instance-1652917464</nova:name>
Aug 09 00:56:50 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:56:50</nova:creationTime>
Aug 09 00:56:50 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:56:50 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:56:50 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:56:50 user nova-compute[72780]:       <nova:owner>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:user uuid="e2ffd7b5f4a244d3a1f8105abd22ef1d">tempest-VolumesActionsTest-952031033-project-member</nova:user>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:project uuid="5ffaebd4a6344e3ea94485cc7d566c0e">tempest-VolumesActionsTest-952031033</nova:project>
Aug 09 00:56:50 user nova-compute[72780]:       </nova:owner>
Aug 09 00:56:50 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:56:50 user nova-compute[72780]:       <nova:ports>
Aug 09 00:56:50 user nova-compute[72780]:         <nova:port uuid="22385121-9085-4dc4-a154-60efde23a647">
Aug 09 00:56:50 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 00:56:50 user nova-compute[72780]:         </nova:port>
Aug 09 00:56:50 user nova-compute[72780]:       </nova:ports>
Aug 09 00:56:50 user nova-compute[72780]:     </nova:instance>
Aug 09 00:56:50 user nova-compute[72780]:   </metadata>
Aug 09 00:56:50 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:56:50 user nova-compute[72780]:     <system>
Aug 09 00:56:50 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:56:50 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:56:50 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:56:50 user nova-compute[72780]:       <entry name="serial">b907b883-5bd6-4387-bc37-a15bff3c00ff</entry>
Aug 09 00:56:50 user nova-compute[72780]:       <entry name="uuid">b907b883-5bd6-4387-bc37-a15bff3c00ff</entry>
Aug 09 00:56:50 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:56:50 user nova-compute[72780]:     </system>
Aug 09 00:56:50 user nova-compute[72780]:   </sysinfo>
Aug 09 00:56:50 user nova-compute[72780]:   <os>
Aug 09 00:56:50 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:56:50 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:56:50 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:56:50 user nova-compute[72780]:   </os>
Aug 09 00:56:50 user nova-compute[72780]:   <features>
Aug 09 00:56:50 user nova-compute[72780]:     <acpi/>
Aug 09 00:56:50 user nova-compute[72780]:     <apic/>
Aug 09 00:56:50 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:56:50 user nova-compute[72780]:   </features>
Aug 09 00:56:50 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:56:50 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:56:50 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:56:50 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:56:50 user nova-compute[72780]:   </clock>
Aug 09 00:56:50 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:56:50 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:56:50 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:56:50 user nova-compute[72780]:   </cpu>
Aug 09 00:56:50 user nova-compute[72780]:   <devices>
Aug 09 00:56:50 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:56:50 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:56:50 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk"/>
Aug 09 00:56:50 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:56:50 user nova-compute[72780]:     </disk>
Aug 09 00:56:50 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:56:50 user nova-compute[72780]:       <mac address="fa:16:3e:62:d5:e1"/>
Aug 09 00:56:50 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:56:50 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:56:50 user nova-compute[72780]:       <target dev="tap22385121-90"/>
Aug 09 00:56:50 user nova-compute[72780]:     </interface>
Aug 09 00:56:50 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:56:50 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/console.log" append="off"/>
Aug 09 00:56:50 user nova-compute[72780]:     </serial>
Aug 09 00:56:50 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:56:50 user nova-compute[72780]:     <video>
Aug 09 00:56:50 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:56:50 user nova-compute[72780]:     </video>
Aug 09 00:56:50 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:56:50 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:56:50 user nova-compute[72780]:     </rng>
Aug 09 00:56:50 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:56:50 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:56:50 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:56:50 user nova-compute[72780]:     </memballoon>
Aug 09 00:56:50 user nova-compute[72780]:   </devices>
Aug 09 00:56:50 user nova-compute[72780]: </domain>
Aug 09 00:56:50 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1652917464',display_name='tempest-VolumesActionsTest-instance-1652917464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1652917464',id=15,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ffaebd4a6344e3ea94485cc7d566c0e',ramdisk_id='',reservation_id='r-rno5bscc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-952031033',owner_user_name='tempest-VolumesActionsTest-952031033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:56:48Z,user_data=None,user_id='e2ffd7b5f4a244d3a1f8105abd22ef1d',uuid=b907b883-5bd6-4387-bc37-a15bff3c00ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Converting VIF {"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG os_vif [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22385121-90, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22385121-90, col_values=(('external_ids', {'iface-id': '22385121-9085-4dc4-a154-60efde23a647', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:d5:e1', 'vm-uuid': 'b907b883-5bd6-4387-bc37-a15bff3c00ff'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:50 user nova-compute[72780]: INFO os_vif [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90')
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] No VIF found with MAC fa:16:3e:62:d5:e1, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.neutron [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Updated VIF entry in instance network info cache for port 22385121-9085-4dc4-a154-60efde23a647. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG nova.network.neutron [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Updating instance_info_cache with network_info: [{"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:56:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5b316a3d-d249-4327-8167-d70c68d27614 req-66bb9daa-0d5b-4426-9c3a-f5ae6eb05346 service nova] Releasing lock "refresh_cache-b907b883-5bd6-4387-bc37-a15bff3c00ff" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:56:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-12acbf11-c9e0-43e9-8cff-70dcf537384d req-91f7d9e3-3616-411e-8951-ac4053b43bd6 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-12acbf11-c9e0-43e9-8cff-70dcf537384d req-91f7d9e3-3616-411e-8951-ac4053b43bd6 service nova] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-12acbf11-c9e0-43e9-8cff-70dcf537384d req-91f7d9e3-3616-411e-8951-ac4053b43bd6 service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-12acbf11-c9e0-43e9-8cff-70dcf537384d req-91f7d9e3-3616-411e-8951-ac4053b43bd6 service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-12acbf11-c9e0-43e9-8cff-70dcf537384d req-91f7d9e3-3616-411e-8951-ac4053b43bd6 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] No waiting events found dispatching network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:52 user nova-compute[72780]: WARNING nova.compute.manager [req-12acbf11-c9e0-43e9-8cff-70dcf537384d req-91f7d9e3-3616-411e-8951-ac4053b43bd6 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received unexpected event network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 for instance with vm_state building and task_state spawning.
Aug 09 00:56:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd408e28-e7d4-45c3-b156-0fbdfbabb8d5 req-1a358715-9245-4395-a375-8a5da45e8966 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd408e28-e7d4-45c3-b156-0fbdfbabb8d5 req-1a358715-9245-4395-a375-8a5da45e8966 service nova] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd408e28-e7d4-45c3-b156-0fbdfbabb8d5 req-1a358715-9245-4395-a375-8a5da45e8966 service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd408e28-e7d4-45c3-b156-0fbdfbabb8d5 req-1a358715-9245-4395-a375-8a5da45e8966 service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd408e28-e7d4-45c3-b156-0fbdfbabb8d5 req-1a358715-9245-4395-a375-8a5da45e8966 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] No waiting events found dispatching network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:56:54 user nova-compute[72780]: WARNING nova.compute.manager [req-fd408e28-e7d4-45c3-b156-0fbdfbabb8d5 req-1a358715-9245-4395-a375-8a5da45e8966 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received unexpected event network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 for instance with vm_state building and task_state spawning.
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542614.4180057, b907b883-5bd6-4387-bc37-a15bff3c00ff => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] VM Resumed (Lifecycle Event)
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Instance spawned successfully.
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542614.4194882, b907b883-5bd6-4387-bc37-a15bff3c00ff => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] VM Started (Lifecycle Event)
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Took 6.51 seconds to spawn the instance on the hypervisor.
Aug 09 00:56:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:56:54 user nova-compute[72780]: INFO nova.compute.manager [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Took 7.40 seconds to build instance.
Aug 09 00:56:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-443294d1-bc13-4a21-be37-7c04014e5504 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.583s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:56:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:56:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "8f761825-14d1-4984-9cec-8b045fba051c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:57:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:04 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:57:04 user nova-compute[72780]: INFO nova.compute.claims [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Claim successful on node user
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:57:05 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:57:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:57:05 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Creating image(s)
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "/opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "/opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG nova.policy [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '632f176971494c9b9b5c01a795bfd5da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50679113ae047e2a63eaf6b16e323f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.178s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk 1073741824" returned: 0 in 0.059s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Cannot resize image /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lazy-loading 'migration_context' on Instance uuid 8f761825-14d1-4984-9cec-8b045fba051c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Ensure instance console log exists: /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Successfully created port: bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Successfully updated port: bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "refresh_cache-8f761825-14d1-4984-9cec-8b045fba051c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquired lock "refresh_cache-8f761825-14d1-4984-9cec-8b045fba051c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-changed-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Refreshing instance network info cache due to event network-changed-bfddc3b0-2315-4817-8676-7659f371c13f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] Acquiring lock "refresh_cache-8f761825-14d1-4984-9cec-8b045fba051c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Updating instance_info_cache with network_info: [{"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Releasing lock "refresh_cache-8f761825-14d1-4984-9cec-8b045fba051c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Instance network_info: |[{"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] Acquired lock "refresh_cache-8f761825-14d1-4984-9cec-8b045fba051c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Refreshing network info cache for port bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Start _get_guest_xml network_info=[{"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:57:09 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:09 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1272300904',display_name='tempest-VolumesNegativeTest-instance-1272300904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1272300904',id=16,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a50679113ae047e2a63eaf6b16e323f8',ramdisk_id='',reservation_id='r-siad40ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1095462826',owner_user_name='tempest-VolumesNegativeTest-1095462826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:05Z,user_data=None,user_id='632f176971494c9b9b5c01a795bfd5da',uuid=8f761825-14d1-4984-9cec-8b045fba051c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Converting VIF {"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f761825-14d1-4984-9cec-8b045fba051c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:57:09 user nova-compute[72780]:   <uuid>8f761825-14d1-4984-9cec-8b045fba051c</uuid>
Aug 09 00:57:09 user nova-compute[72780]:   <name>instance-00000010</name>
Aug 09 00:57:09 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:57:09 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:57:09 user nova-compute[72780]:   <metadata>
Aug 09 00:57:09 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:57:09 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:57:09 user nova-compute[72780]:       <nova:name>tempest-VolumesNegativeTest-instance-1272300904</nova:name>
Aug 09 00:57:09 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:57:09</nova:creationTime>
Aug 09 00:57:09 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:57:09 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:57:09 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:57:09 user nova-compute[72780]:       <nova:owner>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:user uuid="632f176971494c9b9b5c01a795bfd5da">tempest-VolumesNegativeTest-1095462826-project-member</nova:user>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:project uuid="a50679113ae047e2a63eaf6b16e323f8">tempest-VolumesNegativeTest-1095462826</nova:project>
Aug 09 00:57:09 user nova-compute[72780]:       </nova:owner>
Aug 09 00:57:09 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:57:09 user nova-compute[72780]:       <nova:ports>
Aug 09 00:57:09 user nova-compute[72780]:         <nova:port uuid="bfddc3b0-2315-4817-8676-7659f371c13f">
Aug 09 00:57:09 user nova-compute[72780]:           <nova:ip type="fixed" address="192.168.233.169" ipVersion="4"/>
Aug 09 00:57:09 user nova-compute[72780]:         </nova:port>
Aug 09 00:57:09 user nova-compute[72780]:       </nova:ports>
Aug 09 00:57:09 user nova-compute[72780]:     </nova:instance>
Aug 09 00:57:09 user nova-compute[72780]:   </metadata>
Aug 09 00:57:09 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:57:09 user nova-compute[72780]:     <system>
Aug 09 00:57:09 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:57:09 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:57:09 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:57:09 user nova-compute[72780]:       <entry name="serial">8f761825-14d1-4984-9cec-8b045fba051c</entry>
Aug 09 00:57:09 user nova-compute[72780]:       <entry name="uuid">8f761825-14d1-4984-9cec-8b045fba051c</entry>
Aug 09 00:57:09 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:57:09 user nova-compute[72780]:     </system>
Aug 09 00:57:09 user nova-compute[72780]:   </sysinfo>
Aug 09 00:57:09 user nova-compute[72780]:   <os>
Aug 09 00:57:09 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:57:09 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:57:09 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:57:09 user nova-compute[72780]:   </os>
Aug 09 00:57:09 user nova-compute[72780]:   <features>
Aug 09 00:57:09 user nova-compute[72780]:     <acpi/>
Aug 09 00:57:09 user nova-compute[72780]:     <apic/>
Aug 09 00:57:09 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:57:09 user nova-compute[72780]:   </features>
Aug 09 00:57:09 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:57:09 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:57:09 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:57:09 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:57:09 user nova-compute[72780]:   </clock>
Aug 09 00:57:09 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:57:09 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:57:09 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:57:09 user nova-compute[72780]:   </cpu>
Aug 09 00:57:09 user nova-compute[72780]:   <devices>
Aug 09 00:57:09 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:57:09 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:57:09 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk"/>
Aug 09 00:57:09 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:57:09 user nova-compute[72780]:     </disk>
Aug 09 00:57:09 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:57:09 user nova-compute[72780]:       <mac address="fa:16:3e:c0:45:ca"/>
Aug 09 00:57:09 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:57:09 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:57:09 user nova-compute[72780]:       <target dev="tapbfddc3b0-23"/>
Aug 09 00:57:09 user nova-compute[72780]:     </interface>
Aug 09 00:57:09 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:57:09 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/console.log" append="off"/>
Aug 09 00:57:09 user nova-compute[72780]:     </serial>
Aug 09 00:57:09 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:57:09 user nova-compute[72780]:     <video>
Aug 09 00:57:09 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:57:09 user nova-compute[72780]:     </video>
Aug 09 00:57:09 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:57:09 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:57:09 user nova-compute[72780]:     </rng>
Aug 09 00:57:09 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:57:09 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:57:09 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:57:09 user nova-compute[72780]:     </memballoon>
Aug 09 00:57:09 user nova-compute[72780]:   </devices>
Aug 09 00:57:09 user nova-compute[72780]: </domain>
Aug 09 00:57:09 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1272300904',display_name='tempest-VolumesNegativeTest-instance-1272300904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1272300904',id=16,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a50679113ae047e2a63eaf6b16e323f8',ramdisk_id='',reservation_id='r-siad40ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1095462826',owner_user_name='tempest-VolumesNegativeTest-1095462826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:05Z,user_data=None,user_id='632f176971494c9b9b5c01a795bfd5da',uuid=8f761825-14d1-4984-9cec-8b045fba051c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Converting VIF {"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG os_vif [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfddc3b0-23, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfddc3b0-23, col_values=(('external_ids', {'iface-id': 'bfddc3b0-2315-4817-8676-7659f371c13f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:45:ca', 'vm-uuid': '8f761825-14d1-4984-9cec-8b045fba051c'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:09 user nova-compute[72780]: INFO os_vif [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23')
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] No VIF found with MAC fa:16:3e:c0:45:ca, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Updated VIF entry in instance network info cache for port bfddc3b0-2315-4817-8676-7659f371c13f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Updating instance_info_cache with network_info: [{"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9e2529b6-eac3-4cde-8eb8-bfcd5f97d039 req-bb11809e-c331-463a-8c7c-bd5ca627c188 service nova] Releasing lock "refresh_cache-8f761825-14d1-4984-9cec-8b045fba051c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-07e6b2fd-4fde-484b-9423-b630c4db0dda req-a81b451d-44f5-48cc-8e32-4cc5fb1ae039 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07e6b2fd-4fde-484b-9423-b630c4db0dda req-a81b451d-44f5-48cc-8e32-4cc5fb1ae039 service nova] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07e6b2fd-4fde-484b-9423-b630c4db0dda req-a81b451d-44f5-48cc-8e32-4cc5fb1ae039 service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07e6b2fd-4fde-484b-9423-b630c4db0dda req-a81b451d-44f5-48cc-8e32-4cc5fb1ae039 service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-07e6b2fd-4fde-484b-9423-b630c4db0dda req-a81b451d-44f5-48cc-8e32-4cc5fb1ae039 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] No waiting events found dispatching network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:10 user nova-compute[72780]: WARNING nova.compute.manager [req-07e6b2fd-4fde-484b-9423-b630c4db0dda req-a81b451d-44f5-48cc-8e32-4cc5fb1ae039 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received unexpected event network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f for instance with vm_state building and task_state spawning.
Aug 09 00:57:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Skipping network cache update for instance because it is Building. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542632.87492, 8f761825-14d1-4984-9cec-8b045fba051c => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] VM Resumed (Lifecycle Event)
Aug 09 00:57:12 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Instance spawned successfully.
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542632.8754954, 8f761825-14d1-4984-9cec-8b045fba051c => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] VM Started (Lifecycle Event)
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:57:13 user nova-compute[72780]: INFO nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Took 7.62 seconds to spawn the instance on the hypervisor.
Aug 09 00:57:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-b686d396-70fc-4bcf-9f2c-e69a3f8cf7b1 req-773d5380-2747-48af-aced-eb24cbd51b86 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b686d396-70fc-4bcf-9f2c-e69a3f8cf7b1 req-773d5380-2747-48af-aced-eb24cbd51b86 service nova] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b686d396-70fc-4bcf-9f2c-e69a3f8cf7b1 req-773d5380-2747-48af-aced-eb24cbd51b86 service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b686d396-70fc-4bcf-9f2c-e69a3f8cf7b1 req-773d5380-2747-48af-aced-eb24cbd51b86 service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-b686d396-70fc-4bcf-9f2c-e69a3f8cf7b1 req-773d5380-2747-48af-aced-eb24cbd51b86 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] No waiting events found dispatching network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:13 user nova-compute[72780]: WARNING nova.compute.manager [req-b686d396-70fc-4bcf-9f2c-e69a3f8cf7b1 req-773d5380-2747-48af-aced-eb24cbd51b86 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received unexpected event network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f for instance with vm_state building and task_state spawning.
Aug 09 00:57:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:13 user nova-compute[72780]: INFO nova.compute.manager [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Took 8.58 seconds to build instance.
Aug 09 00:57:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-673ca26e-71a8-4027-b30a-bc0643399c61 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "8f761825-14d1-4984-9cec-8b045fba051c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.717s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:57:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:57:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7325MB free_disk=25.361328125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance deec36f5-a323-4595-b87a-abc995824040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance b907b883-5bd6-4387-bc37-a15bff3c00ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8f761825-14d1-4984-9cec-8b045fba051c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:57:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:22 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:22 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:26 user nova-compute[72780]: INFO nova.compute.manager [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] instance snapshotting
Aug 09 00:57:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Beginning live snapshot process
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa4whiql9/a5f3136ff9da40d7963fea0b4fa1a1d1.delta 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa4whiql9/a5f3136ff9da40d7963fea0b4fa1a1d1.delta 1073741824" returned: 0 in 0.064s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 00:57:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:57:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:28 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:57:28 user nova-compute[72780]: INFO nova.compute.claims [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Claim successful on node user
Aug 09 00:57:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] COPY block job progress, current cursor: 9961472 final cursor: 75563008 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.882s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:57:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.policy [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0456a39aaa64bdca5df6a3b67ea9d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0bd68653554fafa823eacae86e21a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 00:57:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:57:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Creating image(s)
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "/opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa4whiql9/a5f3136ff9da40d7963fea0b4fa1a1d1.delta /opt/stack/data/nova/instances/snapshots/tmpa4whiql9/a5f3136ff9da40d7963fea0b4fa1a1d1 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk 1073741824" returned: 0 in 0.050s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa4whiql9/a5f3136ff9da40d7963fea0b4fa1a1d1.delta /opt/stack/data/nova/instances/snapshots/tmpa4whiql9/a5f3136ff9da40d7963fea0b4fa1a1d1" returned: 0 in 0.341s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Snapshot extracted, beginning image upload
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Successfully created port: 6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Cannot resize image /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG nova.objects.instance [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'migration_context' on Instance uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Ensure instance console log exists: /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Successfully updated port: 6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquired lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-changed-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Refreshing instance network info cache due to event network-changed-6ea508fa-8a89-4c69-9841-85b4769b06fe. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] Acquiring lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:31 user nova-compute[72780]: INFO nova.compute.manager [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Detaching volume 40ddfc57-e117-427e-8bbd-8afded01812e
Aug 09 00:57:31 user nova-compute[72780]: INFO nova.virt.block_device [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Attempting to driver detach volume 40ddfc57-e117-427e-8bbd-8afded01812e from mountpoint /dev/vdb
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Attempting to detach device vdb from instance 1928c3a6-c836-4487-bc21-5eb902fb61fa from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:57:31 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:57:31 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:57:31 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:57:31 user nova-compute[72780]:   <serial>40ddfc57-e117-427e-8bbd-8afded01812e</serial>
Aug 09 00:57:31 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 00:57:31 user nova-compute[72780]: </disk>
Aug 09 00:57:31 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:57:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully detached device vdb from instance 1928c3a6-c836-4487-bc21-5eb902fb61fa from the persistent domain config.
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1928c3a6-c836-4487-bc21-5eb902fb61fa from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:57:31 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:57:31 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:57:31 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:57:31 user nova-compute[72780]:   <serial>40ddfc57-e117-427e-8bbd-8afded01812e</serial>
Aug 09 00:57:31 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 00:57:31 user nova-compute[72780]: </disk>
Aug 09 00:57:31 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updating instance_info_cache with network_info: [{"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Releasing lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Instance network_info: |[{"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] Acquired lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Refreshing network info cache for port 6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Start _get_guest_xml network_info=[{"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:57:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1273789156',display_name='tempest-AttachVolumeNegativeTest-server-1273789156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1273789156',id=17,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBjozkenfdrB2G47pIQhN2BeDQwIVcDbQky1bkOzmiHi3xYOgLdgjJhKjQsUu454W6G20Jki4hqCurD2XPX3stIeqt3/sdQnpftgnnB2DrfX9VDdy6aPVfbgot4CGsK5A==',key_name='tempest-keypair-192565528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-x9kbx5gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=a35ae1e9-1559-41c8-8476-d571b679c084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'pci_devices' on Instance uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:57:31 user nova-compute[72780]:   <uuid>a35ae1e9-1559-41c8-8476-d571b679c084</uuid>
Aug 09 00:57:31 user nova-compute[72780]:   <name>instance-00000011</name>
Aug 09 00:57:31 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:57:31 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:57:31 user nova-compute[72780]:   <metadata>
Aug 09 00:57:31 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:57:31 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:57:31 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1273789156</nova:name>
Aug 09 00:57:31 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:57:31</nova:creationTime>
Aug 09 00:57:31 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:57:31 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:57:31 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:57:31 user nova-compute[72780]:       <nova:owner>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:user uuid="f0456a39aaa64bdca5df6a3b67ea9d68">tempest-AttachVolumeNegativeTest-1434038909-project-member</nova:user>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:project uuid="dd0bd68653554fafa823eacae86e21a0">tempest-AttachVolumeNegativeTest-1434038909</nova:project>
Aug 09 00:57:31 user nova-compute[72780]:       </nova:owner>
Aug 09 00:57:31 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:57:31 user nova-compute[72780]:       <nova:ports>
Aug 09 00:57:31 user nova-compute[72780]:         <nova:port uuid="6ea508fa-8a89-4c69-9841-85b4769b06fe">
Aug 09 00:57:31 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 00:57:31 user nova-compute[72780]:         </nova:port>
Aug 09 00:57:31 user nova-compute[72780]:       </nova:ports>
Aug 09 00:57:31 user nova-compute[72780]:     </nova:instance>
Aug 09 00:57:31 user nova-compute[72780]:   </metadata>
Aug 09 00:57:31 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:57:31 user nova-compute[72780]:     <system>
Aug 09 00:57:31 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:57:31 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:57:31 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:57:31 user nova-compute[72780]:       <entry name="serial">a35ae1e9-1559-41c8-8476-d571b679c084</entry>
Aug 09 00:57:31 user nova-compute[72780]:       <entry name="uuid">a35ae1e9-1559-41c8-8476-d571b679c084</entry>
Aug 09 00:57:31 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:57:31 user nova-compute[72780]:     </system>
Aug 09 00:57:31 user nova-compute[72780]:   </sysinfo>
Aug 09 00:57:31 user nova-compute[72780]:   <os>
Aug 09 00:57:31 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:57:31 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:57:31 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:57:31 user nova-compute[72780]:   </os>
Aug 09 00:57:31 user nova-compute[72780]:   <features>
Aug 09 00:57:31 user nova-compute[72780]:     <acpi/>
Aug 09 00:57:31 user nova-compute[72780]:     <apic/>
Aug 09 00:57:31 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:57:31 user nova-compute[72780]:   </features>
Aug 09 00:57:31 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:57:31 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:57:31 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:57:31 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:57:31 user nova-compute[72780]:   </clock>
Aug 09 00:57:31 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:57:31 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:57:31 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:57:31 user nova-compute[72780]:   </cpu>
Aug 09 00:57:31 user nova-compute[72780]:   <devices>
Aug 09 00:57:31 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:57:31 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:57:31 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk"/>
Aug 09 00:57:31 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:57:31 user nova-compute[72780]:     </disk>
Aug 09 00:57:31 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:57:31 user nova-compute[72780]:       <mac address="fa:16:3e:14:84:20"/>
Aug 09 00:57:31 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:57:31 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:57:31 user nova-compute[72780]:       <target dev="tap6ea508fa-8a"/>
Aug 09 00:57:31 user nova-compute[72780]:     </interface>
Aug 09 00:57:31 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:57:31 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/console.log" append="off"/>
Aug 09 00:57:31 user nova-compute[72780]:     </serial>
Aug 09 00:57:31 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:57:31 user nova-compute[72780]:     <video>
Aug 09 00:57:31 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:57:31 user nova-compute[72780]:     </video>
Aug 09 00:57:31 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:57:31 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:57:31 user nova-compute[72780]:     </rng>
Aug 09 00:57:31 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:57:31 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:57:31 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:57:31 user nova-compute[72780]:     </memballoon>
Aug 09 00:57:31 user nova-compute[72780]:   </devices>
Aug 09 00:57:31 user nova-compute[72780]: </domain>
Aug 09 00:57:31 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1273789156',display_name='tempest-AttachVolumeNegativeTest-server-1273789156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1273789156',id=17,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBjozkenfdrB2G47pIQhN2BeDQwIVcDbQky1bkOzmiHi3xYOgLdgjJhKjQsUu454W6G20Jki4hqCurD2XPX3stIeqt3/sdQnpftgnnB2DrfX9VDdy6aPVfbgot4CGsK5A==',key_name='tempest-keypair-192565528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-x9kbx5gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=a35ae1e9-1559-41c8-8476-d571b679c084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG os_vif [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ea508fa-8a, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ea508fa-8a, col_values=(('external_ids', {'iface-id': '6ea508fa-8a89-4c69-9841-85b4769b06fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:84:20', 'vm-uuid': 'a35ae1e9-1559-41c8-8476-d571b679c084'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:57:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:31 user nova-compute[72780]: INFO os_vif [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a')
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:14:84:20, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542652.1160831, 1928c3a6-c836-4487-bc21-5eb902fb61fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:57:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully detached device vdb from instance 1928c3a6-c836-4487-bc21-5eb902fb61fa from the live domain config.
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uHrnjJko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:57:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d5cd3-3758-4ac2-a10a-946020137e44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8876296-7b55-41d7-b155-eaa06a8848df]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:57:32 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:57:32 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:57:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:57:32 user nova-compute[72780]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e (non-flash)
Aug 09 00:57:32 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:57:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01ee050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bba638-bd6a-4ba1-89a8-a0290ef41331]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d0b62-ddf8-4fe3-8e13-e15d0f8fe9ae]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccae0ad-93b0-43e7-8f41-e796f1f7f169]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d31c69e-5fcc-49ba-8cef-070eff895f1d]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.network.neutron [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updated VIF entry in instance network info cache for port 6ea508fa-8a89-4c69-9841-85b4769b06fe. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.network.neutron [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updating instance_info_cache with network_info: [{"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[045cc57b-8d35-4444-b4c3-2de14f685031]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ae314324-1cb3-4cdd-a989-7b4802837c20 req-777ead8a-7828-4b50-bd9c-33df9a787f5e service nova] Releasing lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40ba8a9-291e-4985-bbfc-203c01a22f02]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260]
Aug 09 00:57:32 user nova-compute[72780]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e, portal: 172.16.0.220,3260] successful.
Aug 09 00:57:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40ddfc57-e117-427e-8bbd-8afded01812e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[077112ad-9dec-4b01-ab7e-75aeef1b4629]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== disconnect_volume: return (349ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:57:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:57:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Snapshot image upload complete
Aug 09 00:57:32 user nova-compute[72780]: INFO nova.compute.manager [None req-3cc4e58e-b319-482d-9173-ae26fa1dc0e2 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Took 5.84 seconds to snapshot the instance on the hypervisor.
Aug 09 00:57:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ac1c9e80-fcbb-4979-b92b-f8b78f0bd991 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.086s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-d10251a4-e8ce-4926-bb84-195e33223c47 req-ad7e790b-a153-4d46-a250-78da5951c1c3 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d10251a4-e8ce-4926-bb84-195e33223c47 req-ad7e790b-a153-4d46-a250-78da5951c1c3 service nova] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d10251a4-e8ce-4926-bb84-195e33223c47 req-ad7e790b-a153-4d46-a250-78da5951c1c3 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d10251a4-e8ce-4926-bb84-195e33223c47 req-ad7e790b-a153-4d46-a250-78da5951c1c3 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-d10251a4-e8ce-4926-bb84-195e33223c47 req-ad7e790b-a153-4d46-a250-78da5951c1c3 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] No waiting events found dispatching network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:33 user nova-compute[72780]: WARNING nova.compute.manager [req-d10251a4-e8ce-4926-bb84-195e33223c47 req-ad7e790b-a153-4d46-a250-78da5951c1c3 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received unexpected event network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe for instance with vm_state building and task_state spawning.
Aug 09 00:57:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72780) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 00:57:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG nova.compute.manager [req-fb0f1137-a678-415f-b381-012bddd061d5 req-b22b4f7c-b144-4181-a8df-32ac33404f76 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb0f1137-a678-415f-b381-012bddd061d5 req-b22b4f7c-b144-4181-a8df-32ac33404f76 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb0f1137-a678-415f-b381-012bddd061d5 req-b22b4f7c-b144-4181-a8df-32ac33404f76 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb0f1137-a678-415f-b381-012bddd061d5 req-b22b4f7c-b144-4181-a8df-32ac33404f76 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG nova.compute.manager [req-fb0f1137-a678-415f-b381-012bddd061d5 req-b22b4f7c-b144-4181-a8df-32ac33404f76 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:34 user nova-compute[72780]: WARNING nova.compute.manager [req-fb0f1137-a678-415f-b381-012bddd061d5 req-b22b4f7c-b144-4181-a8df-32ac33404f76 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state active and task_state powering-off.
Aug 09 00:57:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance destroyed successfully.
Aug 09 00:57:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1e5e07f1-96b3-4e79-b8f5-582e21ab6fe2 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.955s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:57:35 user nova-compute[72780]: INFO nova.compute.claims [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Claim successful on node user
Aug 09 00:57:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-4c663a4b-721c-43b3-9da8-55c6b45e586e req-e0d1f64c-6fa8-43e3-9925-836218de5b64 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c663a4b-721c-43b3-9da8-55c6b45e586e req-e0d1f64c-6fa8-43e3-9925-836218de5b64 service nova] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c663a4b-721c-43b3-9da8-55c6b45e586e req-e0d1f64c-6fa8-43e3-9925-836218de5b64 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c663a4b-721c-43b3-9da8-55c6b45e586e req-e0d1f64c-6fa8-43e3-9925-836218de5b64 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-4c663a4b-721c-43b3-9da8-55c6b45e586e req-e0d1f64c-6fa8-43e3-9925-836218de5b64 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] No waiting events found dispatching network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:35 user nova-compute[72780]: WARNING nova.compute.manager [req-4c663a4b-721c-43b3-9da8-55c6b45e586e req-e0d1f64c-6fa8-43e3-9925-836218de5b64 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received unexpected event network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe for instance with vm_state building and task_state spawning.
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542655.7788432, a35ae1e9-1559-41c8-8476-d571b679c084 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:35 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] VM Resumed (Lifecycle Event)
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:57:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Instance spawned successfully.
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:35 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542655.785499, a35ae1e9-1559-41c8-8476-d571b679c084 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:35 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] VM Started (Lifecycle Event)
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:35 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:57:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:57:36 user nova-compute[72780]: INFO nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:57:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:57:36 user nova-compute[72780]: INFO nova.compute.manager [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Took 7.62 seconds to build instance.
Aug 09 00:57:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-060e3fe8-aac2-4b07-97e4-0ca65ad6d0b0 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.716s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:57:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Creating image(s)
Aug 09 00:57:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "/opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "/opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "458507dfa1733b8e984df6f532536ed357b09e47" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "458507dfa1733b8e984df6f532536ed357b09e47" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:36 user nova-compute[72780]: DEBUG nova.policy [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bade11d5ae3a4aa4bca3a34aa14298ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9106ffe1447fa6b5ee6fbfc58417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-3cc2942d-3e13-4fbe-ad8b-b2998f4e8d3c req-f31d4499-bf1a-4426-b16a-63eaa00dca48 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3cc2942d-3e13-4fbe-ad8b-b2998f4e8d3c req-f31d4499-bf1a-4426-b16a-63eaa00dca48 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3cc2942d-3e13-4fbe-ad8b-b2998f4e8d3c req-f31d4499-bf1a-4426-b16a-63eaa00dca48 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3cc2942d-3e13-4fbe-ad8b-b2998f4e8d3c req-f31d4499-bf1a-4426-b16a-63eaa00dca48 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-3cc2942d-3e13-4fbe-ad8b-b2998f4e8d3c req-f31d4499-bf1a-4426-b16a-63eaa00dca48 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:37 user nova-compute[72780]: WARNING nova.compute.manager [req-3cc2942d-3e13-4fbe-ad8b-b2998f4e8d3c req-f31d4499-bf1a-4426-b16a-63eaa00dca48 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state None.
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.part --force-share --output=json" returned: 0 in 0.232s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG nova.virt.images [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] 1de5f074-9a67-4d03-b2ee-c7812d43949b was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.part /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.part /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.converted" returned: 0 in 0.345s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "458507dfa1733b8e984df6f532536ed357b09e47" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.885s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "458507dfa1733b8e984df6f532536ed357b09e47" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "458507dfa1733b8e984df6f532536ed357b09e47" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Successfully created port: a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47,backing_fmt=raw /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47,backing_fmt=raw /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk 1073741824" returned: 0 in 0.050s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "458507dfa1733b8e984df6f532536ed357b09e47" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 --force-share --output=json" returned: 0 in 0.166s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'migration_context' on Instance uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Ensure instance console log exists: /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Successfully updated port: a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquired lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-changed-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Refreshing instance network info cache due to event network-changed-a45ab989-5763-466b-b942-8c998e5c36e1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] Acquiring lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating instance_info_cache with network_info: [{"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Releasing lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Instance network_info: |[{"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] Acquired lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.neutron [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Refreshing network info cache for port a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Start _get_guest_xml network_info=[{"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ddff54e7dbc2e8b907860e7d02d71c10',container_format='bare',created_at=2023-08-09T00:57:27Z,direct_url=<?>,disk_format='qcow2',id=1de5f074-9a67-4d03-b2ee-c7812d43949b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1403409943',owner='fa1d9106ffe1447fa6b5ee6fbfc58417',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T00:57:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '1de5f074-9a67-4d03-b2ee-c7812d43949b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:57:39 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:39 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ddff54e7dbc2e8b907860e7d02d71c10',container_format='bare',created_at=2023-08-09T00:57:27Z,direct_url=<?>,disk_format='qcow2',id=1de5f074-9a67-4d03-b2ee-c7812d43949b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1403409943',owner='fa1d9106ffe1447fa6b5ee6fbfc58417',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T00:57:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-619277494',display_name='tempest-TestStampPattern-server-619277494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-619277494',id=18,image_ref='1de5f074-9a67-4d03-b2ee-c7812d43949b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI07VMD4TclndvCxE6L38Kfcl2+xDDK4chst8IOjrrMvWh8Il4bIaWiI0srekfxk1YveAsel1TDoaTLMrNZK/VdAns7XVogJbCxdGHNJMvvjMwF4xr/mRlMFXTrSY23piA==',key_name='tempest-TestStampPattern-2067735695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa1d9106ffe1447fa6b5ee6fbfc58417',ramdisk_id='',reservation_id='r-wswv592d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='abc4a45e-2b7e-4038-9e67-a16a419e43bb',image_min_disk='1',image_min_ram='0',image_owner_id='fa1d9106ffe1447fa6b5ee6fbfc58417',image_owner_project_name='tempest-TestStampPattern-753935542',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-753935542-project-member',image_user_id='bade11d5ae3a4aa4bca3a34aa14298ce',network_allocated='True',owner_project_name='tempest-TestStampPattern-753935542',owner_user_name='tempest-TestStampPattern-753935542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:36Z,user_data=None,user_id='bade11d5ae3a4aa4bca3a34aa14298ce',uuid=8f1b3dad-b364-43df-acda-8ebb26dbb5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converting VIF {"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:57:39 user nova-compute[72780]:   <uuid>8f1b3dad-b364-43df-acda-8ebb26dbb5c1</uuid>
Aug 09 00:57:39 user nova-compute[72780]:   <name>instance-00000012</name>
Aug 09 00:57:39 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:57:39 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:57:39 user nova-compute[72780]:   <metadata>
Aug 09 00:57:39 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:57:39 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:57:39 user nova-compute[72780]:       <nova:name>tempest-TestStampPattern-server-619277494</nova:name>
Aug 09 00:57:39 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:57:39</nova:creationTime>
Aug 09 00:57:39 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:57:39 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:57:39 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:57:39 user nova-compute[72780]:       <nova:owner>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:user uuid="bade11d5ae3a4aa4bca3a34aa14298ce">tempest-TestStampPattern-753935542-project-member</nova:user>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:project uuid="fa1d9106ffe1447fa6b5ee6fbfc58417">tempest-TestStampPattern-753935542</nova:project>
Aug 09 00:57:39 user nova-compute[72780]:       </nova:owner>
Aug 09 00:57:39 user nova-compute[72780]:       <nova:root type="image" uuid="1de5f074-9a67-4d03-b2ee-c7812d43949b"/>
Aug 09 00:57:39 user nova-compute[72780]:       <nova:ports>
Aug 09 00:57:39 user nova-compute[72780]:         <nova:port uuid="a45ab989-5763-466b-b942-8c998e5c36e1">
Aug 09 00:57:39 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 00:57:39 user nova-compute[72780]:         </nova:port>
Aug 09 00:57:39 user nova-compute[72780]:       </nova:ports>
Aug 09 00:57:39 user nova-compute[72780]:     </nova:instance>
Aug 09 00:57:39 user nova-compute[72780]:   </metadata>
Aug 09 00:57:39 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:57:39 user nova-compute[72780]:     <system>
Aug 09 00:57:39 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:57:39 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:57:39 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:57:39 user nova-compute[72780]:       <entry name="serial">8f1b3dad-b364-43df-acda-8ebb26dbb5c1</entry>
Aug 09 00:57:39 user nova-compute[72780]:       <entry name="uuid">8f1b3dad-b364-43df-acda-8ebb26dbb5c1</entry>
Aug 09 00:57:39 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:57:39 user nova-compute[72780]:     </system>
Aug 09 00:57:39 user nova-compute[72780]:   </sysinfo>
Aug 09 00:57:39 user nova-compute[72780]:   <os>
Aug 09 00:57:39 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:57:39 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:57:39 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:57:39 user nova-compute[72780]:   </os>
Aug 09 00:57:39 user nova-compute[72780]:   <features>
Aug 09 00:57:39 user nova-compute[72780]:     <acpi/>
Aug 09 00:57:39 user nova-compute[72780]:     <apic/>
Aug 09 00:57:39 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:57:39 user nova-compute[72780]:   </features>
Aug 09 00:57:39 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:57:39 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:57:39 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:57:39 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:57:39 user nova-compute[72780]:   </clock>
Aug 09 00:57:39 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:57:39 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:57:39 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:57:39 user nova-compute[72780]:   </cpu>
Aug 09 00:57:39 user nova-compute[72780]:   <devices>
Aug 09 00:57:39 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:57:39 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:57:39 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk"/>
Aug 09 00:57:39 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:57:39 user nova-compute[72780]:     </disk>
Aug 09 00:57:39 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:57:39 user nova-compute[72780]:       <mac address="fa:16:3e:4e:e4:0e"/>
Aug 09 00:57:39 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:57:39 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:57:39 user nova-compute[72780]:       <target dev="tapa45ab989-57"/>
Aug 09 00:57:39 user nova-compute[72780]:     </interface>
Aug 09 00:57:39 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:57:39 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/console.log" append="off"/>
Aug 09 00:57:39 user nova-compute[72780]:     </serial>
Aug 09 00:57:39 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:57:39 user nova-compute[72780]:     <video>
Aug 09 00:57:39 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:57:39 user nova-compute[72780]:     </video>
Aug 09 00:57:39 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:57:39 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:57:39 user nova-compute[72780]:     </rng>
Aug 09 00:57:39 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:57:39 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:57:39 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:57:39 user nova-compute[72780]:     </memballoon>
Aug 09 00:57:39 user nova-compute[72780]:   </devices>
Aug 09 00:57:39 user nova-compute[72780]: </domain>
Aug 09 00:57:39 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-619277494',display_name='tempest-TestStampPattern-server-619277494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-619277494',id=18,image_ref='1de5f074-9a67-4d03-b2ee-c7812d43949b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI07VMD4TclndvCxE6L38Kfcl2+xDDK4chst8IOjrrMvWh8Il4bIaWiI0srekfxk1YveAsel1TDoaTLMrNZK/VdAns7XVogJbCxdGHNJMvvjMwF4xr/mRlMFXTrSY23piA==',key_name='tempest-TestStampPattern-2067735695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa1d9106ffe1447fa6b5ee6fbfc58417',ramdisk_id='',reservation_id='r-wswv592d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='abc4a45e-2b7e-4038-9e67-a16a419e43bb',image_min_disk='1',image_min_ram='0',image_owner_id='fa1d9106ffe1447fa6b5ee6fbfc58417',image_owner_project_name='tempest-TestStampPattern-753935542',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-753935542-project-member',image_user_id='bade11d5ae3a4aa4bca3a34aa14298ce',network_allocated='True',owner_project_name='tempest-TestStampPattern-753935542',owner_user_name='tempest-TestStampPattern-753935542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:36Z,user_data=None,user_id='bade11d5ae3a4aa4bca3a34aa14298ce',uuid=8f1b3dad-b364-43df-acda-8ebb26dbb5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converting VIF {"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG os_vif [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa45ab989-57, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa45ab989-57, col_values=(('external_ids', {'iface-id': 'a45ab989-5763-466b-b942-8c998e5c36e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:e4:0e', 'vm-uuid': '8f1b3dad-b364-43df-acda-8ebb26dbb5c1'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:57:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:40 user nova-compute[72780]: INFO os_vif [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57')
Aug 09 00:57:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No VIF found with MAC fa:16:3e:4e:e4:0e, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG nova.network.neutron [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updated VIF entry in instance network info cache for port a45ab989-5763-466b-b942-8c998e5c36e1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG nova.network.neutron [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating instance_info_cache with network_info: [{"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c95fd98-0c19-418d-b53f-65d829a2107b req-b61a3178-4f7a-427c-8fc0-02ba3300dff9 service nova] Releasing lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:57:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-978b0c41-09c9-439b-abad-ed648d7715ce req-7e2ebe50-000a-4a5c-8ae7-0fc02dc96426 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-978b0c41-09c9-439b-abad-ed648d7715ce req-7e2ebe50-000a-4a5c-8ae7-0fc02dc96426 service nova] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-978b0c41-09c9-439b-abad-ed648d7715ce req-7e2ebe50-000a-4a5c-8ae7-0fc02dc96426 service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-978b0c41-09c9-439b-abad-ed648d7715ce req-7e2ebe50-000a-4a5c-8ae7-0fc02dc96426 service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-978b0c41-09c9-439b-abad-ed648d7715ce req-7e2ebe50-000a-4a5c-8ae7-0fc02dc96426 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] No waiting events found dispatching network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:42 user nova-compute[72780]: WARNING nova.compute.manager [req-978b0c41-09c9-439b-abad-ed648d7715ce req-7e2ebe50-000a-4a5c-8ae7-0fc02dc96426 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received unexpected event network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 for instance with vm_state building and task_state spawning.
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-937f0740-8d32-46c2-bead-123711f3458a req-4eb263b7-e084-46fd-bbb8-356e210fafdc service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-937f0740-8d32-46c2-bead-123711f3458a req-4eb263b7-e084-46fd-bbb8-356e210fafdc service nova] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-937f0740-8d32-46c2-bead-123711f3458a req-4eb263b7-e084-46fd-bbb8-356e210fafdc service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-937f0740-8d32-46c2-bead-123711f3458a req-4eb263b7-e084-46fd-bbb8-356e210fafdc service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-937f0740-8d32-46c2-bead-123711f3458a req-4eb263b7-e084-46fd-bbb8-356e210fafdc service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] No waiting events found dispatching network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:57:44 user nova-compute[72780]: WARNING nova.compute.manager [req-937f0740-8d32-46c2-bead-123711f3458a req-4eb263b7-e084-46fd-bbb8-356e210fafdc service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received unexpected event network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 for instance with vm_state building and task_state spawning.
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542664.1034393, 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] VM Resumed (Lifecycle Event)
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Instance spawned successfully.
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542664.1045368, 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] VM Started (Lifecycle Event)
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 09 00:57:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:57:44 user nova-compute[72780]: INFO nova.compute.manager [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Took 8.95 seconds to build instance.
Aug 09 00:57:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3ba7ad51-6f9a-45a7-b5a5-0d1db271dc97 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.070s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:49 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542654.789967, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:57:49 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Stopped (Lifecycle Event)
Aug 09 00:57:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-bf60ecf8-8090-4b3f-8c31-8c72c51b192f None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:57:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-bf60ecf8-8090-4b3f-8c31-8c72c51b192f None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:57:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid b907b883-5bd6-4387-bc37-a15bff3c00ff {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 8f761825-14d1-4984-9cec-8b045fba051c {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "deec36f5-a323-4595-b87a-abc995824040" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "8f761825-14d1-4984-9cec-8b045fba051c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:57:52 user nova-compute[72780]: WARNING oslo_messaging._drivers.amqpdriver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "8f761825-14d1-4984-9cec-8b045fba051c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "deec36f5-a323-4595-b87a-abc995824040" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:57:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:57:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:07 user nova-compute[72780]: INFO nova.compute.manager [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Unrescuing
Aug 09 00:58:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:58:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:58:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'flavor' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-82d19c2c-368b-4dad-9985-c3d8fbcd2c88 req-d75f010e-921e-49a9-a028-2e266c138764 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-82d19c2c-368b-4dad-9985-c3d8fbcd2c88 req-d75f010e-921e-49a9-a028-2e266c138764 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-82d19c2c-368b-4dad-9985-c3d8fbcd2c88 req-d75f010e-921e-49a9-a028-2e266c138764 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-82d19c2c-368b-4dad-9985-c3d8fbcd2c88 req-d75f010e-921e-49a9-a028-2e266c138764 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-82d19c2c-368b-4dad-9985-c3d8fbcd2c88 req-d75f010e-921e-49a9-a028-2e266c138764 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:08 user nova-compute[72780]: WARNING nova.compute.manager [req-82d19c2c-368b-4dad-9985-c3d8fbcd2c88 req-d75f010e-921e-49a9-a028-2e266c138764 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state rescued and task_state unrescuing.
Aug 09 00:58:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance destroyed successfully.
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:10 user nova-compute[72780]: WARNING nova.compute.manager [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state rescued and task_state unrescuing.
Aug 09 00:58:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:10 user nova-compute[72780]: WARNING nova.compute.manager [req-3961f6f9-40c4-44fb-89e3-98557237738e req-d55b37b7-9f90-49ff-969e-dcf6573aa71a service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state rescued and task_state unrescuing.
Aug 09 00:58:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for a76eeaad-0c42-45c7-8351-a3dacdad0574 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542692.471011, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:58:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Resumed (Lifecycle Event)
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b4467a09-0565-4865-856a-03ecdfa379be tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:58:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542692.473982, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:58:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Started (Lifecycle Event)
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-21ef1a11-0123-417c-99a5-45b1012bfe0d req-5a070c5e-4942-49b3-8f20-096ee062e872 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-21ef1a11-0123-417c-99a5-45b1012bfe0d req-5a070c5e-4942-49b3-8f20-096ee062e872 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-21ef1a11-0123-417c-99a5-45b1012bfe0d req-5a070c5e-4942-49b3-8f20-096ee062e872 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-21ef1a11-0123-417c-99a5-45b1012bfe0d req-5a070c5e-4942-49b3-8f20-096ee062e872 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-21ef1a11-0123-417c-99a5-45b1012bfe0d req-5a070c5e-4942-49b3-8f20-096ee062e872 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:12 user nova-compute[72780]: WARNING nova.compute.manager [req-21ef1a11-0123-417c-99a5-45b1012bfe0d req-5a070c5e-4942-49b3-8f20-096ee062e872 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state active and task_state None.
Aug 09 00:58:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updating instance_info_cache with network_info: [{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:58:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:58:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:58:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:19 user nova-compute[72780]: INFO nova.compute.manager [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Detaching volume 2e7d23de-383e-4a37-81ab-493875aa2da1
Aug 09 00:58:19 user nova-compute[72780]: INFO nova.virt.block_device [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Attempting to driver detach volume 2e7d23de-383e-4a37-81ab-493875aa2da1 from mountpoint /dev/vdb
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Attempting to detach device vdb from instance c57928fc-08eb-407f-9e94-baf32611ac9e from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:58:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:58:19 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 00:58:19 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:58:19 user nova-compute[72780]:   <serial>2e7d23de-383e-4a37-81ab-493875aa2da1</serial>
Aug 09 00:58:19 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 00:58:19 user nova-compute[72780]: </disk>
Aug 09 00:58:19 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:58:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully detached device vdb from instance c57928fc-08eb-407f-9e94-baf32611ac9e from the persistent domain config.
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c57928fc-08eb-407f-9e94-baf32611ac9e from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:58:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:58:19 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 00:58:19 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:58:19 user nova-compute[72780]:   <serial>2e7d23de-383e-4a37-81ab-493875aa2da1</serial>
Aug 09 00:58:19 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 00:58:19 user nova-compute[72780]: </disk>
Aug 09 00:58:19 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542699.7514923, c57928fc-08eb-407f-9e94-baf32611ac9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:58:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully detached device vdb from instance c57928fc-08eb-407f-9e94-baf32611ac9e from the live domain config.
Aug 09 00:58:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBbioqWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1462f516-429a-41ff-b558-4e6d89d5d435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f55644-1159-4aa9-a719-1d694d504afe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:19 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:58:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:19 user nova-compute[72780]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 (non-flash)
Aug 09 00:58:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac067b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009c0c4-8ad3-4d44-b44f-e8d77fab5ae1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f48f84e-9c3c-4af5-9b80-6294c35f4cb5]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38da774-51ea-4dfc-872d-18f4a581a656]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e1143-5f19-4bb2-9a01-4548cb918124]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62181cda-07bd-4202-b4c5-944be1b851e2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac765b3-cc1c-459d-9d60-01a76162d260]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260]
Aug 09 00:58:20 user nova-compute[72780]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1, portal: 172.16.0.220,3260] successful.
Aug 09 00:58:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e7d23de-383e-4a37-81ab-493875aa2da1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[383432dc-2ad7-4626-80b5-5ad08de0b2e7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== disconnect_volume: return (308ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:58:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:58:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:58:20 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=25.146995544433594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'flavor' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c4fb988c-6a6c-4b6b-95ac-a8e23df3e65b tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.835s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance deec36f5-a323-4595-b87a-abc995824040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance b907b883-5bd6-4387-bc37-a15bff3c00ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8f761825-14d1-4984-9cec-8b045fba051c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a35ae1e9-1559-41c8-8476-d571b679c084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:58:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.830s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-changed-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Refreshing instance network info cache due to event network-changed-adfb9c3d-dc70-4459-bb67-7456bb6281ea. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] Acquiring lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] Acquired lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Refreshing network info cache for port adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Updated VIF entry in instance network info cache for port adfb9c3d-dc70-4459-bb67-7456bb6281ea. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Updating instance_info_cache with network_info: [{"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-45c1b9b0-5332-40df-b6c9-1ae3c724aa85 req-6e5d5ead-68cd-4d51-9d59-e10d9f30b6f5 service nova] Releasing lock "refresh_cache-deec36f5-a323-4595-b87a-abc995824040" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:58:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'flavor' on Instance uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:27 user nova-compute[72780]: INFO nova.compute.manager [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Attaching volume 6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 to /dev/vdb
Aug 09 00:58:27 user nova-compute[72780]: DEBUG os_brick.utils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1736466e-5912-43b7-aee8-fcfb50091956]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c592c9c0-0237-45a9-aa2c-04428243d83e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d359d1d-806b-458c-91bd-bd7343b7c448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b11530e-dc5e-4c46-b61e-4a890a24bdcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:58:27 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:58:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ffb5ed-c72f-4e8f-8d2a-12ecfcea51b7]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG os_brick.utils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:27 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Updating existing volume attachment record: be1b7dde-dc99-4d61-9cff-c18f4a991d1c {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:58:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'flavor' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:31 user nova-compute[72780]: INFO nova.compute.manager [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Attaching volume cc9917b1-e23b-43f1-ae97-02dba67e4095 to /dev/vdb
Aug 09 00:58:31 user nova-compute[72780]: DEBUG os_brick.utils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce675ff-5b08-4151-87ec-c849222d519f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4a805-9b68-4fce-b177-7b65314df5ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0212c069-9ded-44d2-815f-5cc82e003159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a1fdb-71c6-4fe1-9d99-044b954b1acd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:58:31 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:58:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fe6d36-293b-4ea6-ac51-7f0475e6be75]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG os_brick.utils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:31 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating existing volume attachment record: 15b82c56-0f71-4b8f-b23c-99e80bcc4010 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDVRxXyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:35 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:35 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:35 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f45b1-384c-49f0-852d-7a3ef180c7ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:58:35 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37cd36-0a6c-4ffc-86a6-8ca70f495182]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4] added
Aug 09 00:58:35 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270c2ce-bae2-4305-ab10-29ca559297ff]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc89d9e9-b86f-4664-a4ae-fd5439b0774a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDVRxXyh {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDVRxXyh" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cfd72c-28e7-4b2c-9fa1-82c1180e5011]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDVRxXyh'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab92a350-f6ea-4183-9344-80059d9b4573]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c822ed67-151c-402f-b9bc-a8546cbd395d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:35 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:35 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ff5a5-8b64-486c-9176-e8587c157772]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260]
Aug 09 00:58:35 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260] successful.
Aug 09 00:58:35 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a6077-08a8-4424-a40e-74ca8067b077]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b406cfdc-5568-4f90-9caf-c27043a9f911]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:35 user nova-compute[72780]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 (non-flash)
Aug 09 00:58:35 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:35 user nova-compute[72780]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 (non-flash)
Aug 09 00:58:35 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18783376-4fea-4fd9-bb37-b1a5bfada7e7]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:35 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDVRxXyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26133366264303736', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133366264303736', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG nova.objects.instance [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'flavor' on Instance uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:58:36 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:58:36 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:58:36 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:58:36 user nova-compute[72780]:   <serial>6ccfd005-1c1c-4411-a6e9-006eb0be8bc4</serial>
Aug 09 00:58:36 user nova-compute[72780]: </disk>
Aug 09 00:58:36 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:58:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:58:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:58:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No VIF found with MAC fa:16:3e:a6:68:ec, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:58:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-45a2804c-26fc-43e4-9d2f-c8492628a55e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.650s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:38 user nova-compute[72780]: INFO nova.compute.manager [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Detaching volume 6ccfd005-1c1c-4411-a6e9-006eb0be8bc4
Aug 09 00:58:38 user nova-compute[72780]: INFO nova.virt.block_device [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Attempting to driver detach volume 6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 from mountpoint /dev/vdb
Aug 09 00:58:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Attempting to detach device vdb from instance deec36f5-a323-4595-b87a-abc995824040 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:58:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:58:38 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:58:38 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:58:38 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:58:38 user nova-compute[72780]:   <serial>6ccfd005-1c1c-4411-a6e9-006eb0be8bc4</serial>
Aug 09 00:58:38 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:58:38 user nova-compute[72780]: </disk>
Aug 09 00:58:38 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:58:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Successfully detached device vdb from instance deec36f5-a323-4595-b87a-abc995824040 from the persistent domain config.
Aug 09 00:58:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance deec36f5-a323-4595-b87a-abc995824040 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:58:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:58:38 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:58:38 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:58:38 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:58:38 user nova-compute[72780]:   <serial>6ccfd005-1c1c-4411-a6e9-006eb0be8bc4</serial>
Aug 09 00:58:38 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:58:38 user nova-compute[72780]: </disk>
Aug 09 00:58:38 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542719.3157048, deec36f5-a323-4595-b87a-abc995824040 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:58:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Successfully detached device vdb from instance deec36f5-a323-4595-b87a-abc995824040 from the live domain config.
Aug 09 00:58:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDVRxXyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:39 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f7acf-5f56-4752-b53d-3f4beaa0a3b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dbdf9b-3318-4dd5-9897-aa7921b1d9ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:39 user nova-compute[72780]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 (non-flash)
Aug 09 00:58:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:39 user nova-compute[72780]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 (non-flash)
Aug 09 00:58:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ae661e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[48daffa8-9045-472b-9aae-811c274783ef]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ee46e-2bc6-4c9d-b8ae-c14a0f15c78e]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100950a-ee65-4aeb-921e-3e05b87a2371]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb74840f-493d-4022-ba66-cd8aa783fb07]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ccb0f-ef44-4f56-bc27-0d3c06014fab]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446e439-d1ec-4d09-9849-22429702f3fe]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260]
Aug 09 00:58:39 user nova-compute[72780]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4, portal: 172.16.0.220,3260] successful.
Aug 09 00:58:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccfd005-1c1c-4411-a6e9-006eb0be8bc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa493324-ba23-4b6f-94fe-ef1cec8e74bf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] <== disconnect_volume: return (277ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'flavor' on Instance uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-71388063-5643-4dcf-81e6-0d9bd5177aac tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.693s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:42 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8570b1-50b1-4bc7-9460-8d86362e3d64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:58:42 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eb6c0f-8ae0-47aa-875b-73399fc634ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095] added
Aug 09 00:58:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c682d5e-64c7-4f80-871a-6429b1ebcec0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6acfeb-13f1-4b0c-882c-5bae41cf634a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clmeZgnX {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clmeZgnX" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c526027-ca23-41b4-9dc5-7437eaacde94]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'clmeZgnX'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23c1907-5a86-4dc4-94c6-3d46e6fd2f32]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[304988e3-d52f-4254-ae50-47f56ee5bd08]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[de37c48b-ab03-4cf0-a452-9786e25c5511]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]
Aug 09 00:58:42 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.
Aug 09 00:58:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7d49f-0549-4707-8ce1-0262136fc356]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c3612-e298-483c-a514-78809d0f3f3c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:42 user nova-compute[72780]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:58:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:42 user nova-compute[72780]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:58:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9311ad9-1034-4a54-83ae-c1819dd99ac8]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:58:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:58:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:58:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23062313039316464', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062313039316464', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:58:43 user nova-compute[72780]: DEBUG nova.objects.instance [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'flavor' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:58:44 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:58:44 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 00:58:44 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:58:44 user nova-compute[72780]:   <serial>cc9917b1-e23b-43f1-ae97-02dba67e4095</serial>
Aug 09 00:58:44 user nova-compute[72780]: </disk>
Aug 09 00:58:44 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:58:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:58:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:58:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No VIF found with MAC fa:16:3e:3a:22:77, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:58:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48ad4822-1e3f-46f8-ad63-5d68e22953cc tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.904s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Stashing vm_state: active {{(pid=72780) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 00:58:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:46 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:58:46 user nova-compute[72780]: INFO nova.compute.claims [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Claim successful on node user
Aug 09 00:58:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'resources' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:46 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating resource usage from migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc
Aug 09 00:58:47 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.793s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:47 user nova-compute[72780]: INFO nova.compute.manager [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Migrating
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:58:47 user nova-compute[72780]: INFO nova.compute.rpcapi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:47 user nova-compute[72780]: INFO nova.compute.manager [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Terminating instance
Aug 09 00:58:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Starting migrate_disk_and_power_off {{(pid=72780) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-7fb37453-2b07-4d66-907b-8e5f6b4201d4 req-e82d3446-dbbe-4ae1-ac63-cc37aec6ef3c service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-vif-unplugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7fb37453-2b07-4d66-907b-8e5f6b4201d4 req-e82d3446-dbbe-4ae1-ac63-cc37aec6ef3c service nova] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7fb37453-2b07-4d66-907b-8e5f6b4201d4 req-e82d3446-dbbe-4ae1-ac63-cc37aec6ef3c service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7fb37453-2b07-4d66-907b-8e5f6b4201d4 req-e82d3446-dbbe-4ae1-ac63-cc37aec6ef3c service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-7fb37453-2b07-4d66-907b-8e5f6b4201d4 req-e82d3446-dbbe-4ae1-ac63-cc37aec6ef3c service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] No waiting events found dispatching network-vif-unplugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-7fb37453-2b07-4d66-907b-8e5f6b4201d4 req-e82d3446-dbbe-4ae1-ac63-cc37aec6ef3c service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-vif-unplugged-22385121-9085-4dc4-a154-60efde23a647 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-44753bc5-1ac8-44e9-a958-3522ac307e45 req-af7eb206-d1a8-4873-8b17-6a6bd3e858f6 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-44753bc5-1ac8-44e9-a958-3522ac307e45 req-af7eb206-d1a8-4873-8b17-6a6bd3e858f6 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-44753bc5-1ac8-44e9-a958-3522ac307e45 req-af7eb206-d1a8-4873-8b17-6a6bd3e858f6 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-44753bc5-1ac8-44e9-a958-3522ac307e45 req-af7eb206-d1a8-4873-8b17-6a6bd3e858f6 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-44753bc5-1ac8-44e9-a958-3522ac307e45 req-af7eb206-d1a8-4873-8b17-6a6bd3e858f6 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:48 user nova-compute[72780]: WARNING nova.compute.manager [req-44753bc5-1ac8-44e9-a958-3522ac307e45 req-af7eb206-d1a8-4873-8b17-6a6bd3e858f6 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_migrating.
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Instance destroyed successfully.
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lazy-loading 'resources' on Instance uuid b907b883-5bd6-4387-bc37-a15bff3c00ff {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance destroyed successfully.
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1652917464',display_name='tempest-VolumesActionsTest-instance-1652917464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1652917464',id=15,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ffaebd4a6344e3ea94485cc7d566c0e',ramdisk_id='',reservation_id='r-rno5bscc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-952031033',owner_user_name='tempest-VolumesActionsTest-952031033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:56:55Z,user_data=None,user_id='e2ffd7b5f4a244d3a1f8105abd22ef1d',uuid=b907b883-5bd6-4387-bc37-a15bff3c00ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Converting VIF {"id": "22385121-9085-4dc4-a154-60efde23a647", "address": "fa:16:3e:62:d5:e1", "network": {"id": "47343648-b7f9-49f5-b274-7da38d7cbbb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1334440718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffaebd4a6344e3ea94485cc7d566c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22385121-90", "ovs_interfaceid": "22385121-9085-4dc4-a154-60efde23a647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_vif [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43628f21-b0, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22385121-90, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:58:48 user nova-compute[72780]: INFO os_vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0')
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:48 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:48 user nova-compute[72780]: INFO os_vif [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d5:e1,bridge_name='br-int',has_traffic_filtering=True,id=22385121-9085-4dc4-a154-60efde23a647,network=Network(47343648-b7f9-49f5-b274-7da38d7cbbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22385121-90')
Aug 09 00:58:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Deleting instance files /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff_del
Aug 09 00:58:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Deletion of /opt/stack/data/nova/instances/b907b883-5bd6-4387-bc37-a15bff3c00ff_del complete
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7083fca6-ab6f-4005-8c82-0b51b509f0ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6169e6d1-b723-4799-8f26-ad7c4c50e021]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:48 user nova-compute[72780]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:58:48 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:58:48 user nova-compute[72780]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:58:48 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01d5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:48 user nova-compute[72780]: INFO nova.compute.manager [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae17f9bb-4aec-4e64-b32c-bf6fbfdf7032]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d847ed-91f5-4fe8-b00a-4b205509d1ed]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b3428-af61-48fc-8c78-c62e8d1dc522]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8c0ec-9ce7-4293-8a55-74e597d553bb]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaadb26-5fde-45a7-b2ba-1914365b3040]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f44625-2aec-4ff5-be05-8082d1db03a1]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]
Aug 09 00:58:49 user nova-compute[72780]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.
Aug 09 00:58:49 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a7ebd-5857-4efa-a0bd-ae706894d014]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== disconnect_volume: return (355ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c_resize/disk /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "cp -r /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c_resize/disk /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk" returned: 0 in 0.341s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c_resize/disk.info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk.info {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "cp -r /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c_resize/disk.info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk.info" returned: 0 in 0.037s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-4e0c8131-ea2e-4435-9a91-d7c984142067 req-efed7085-de34-4521-8179-755a297b2552 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-vif-deleted-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:49 user nova-compute[72780]: INFO nova.compute.manager [req-4e0c8131-ea2e-4435-9a91-d7c984142067 req-efed7085-de34-4521-8179-755a297b2552 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Neutron deleted interface 22385121-9085-4dc4-a154-60efde23a647; detaching it from the instance and deleting it from the info cache
Aug 09 00:58:49 user nova-compute[72780]: DEBUG nova.network.neutron [req-4e0c8131-ea2e-4435-9a91-d7c984142067 req-efed7085-de34-4521-8179-755a297b2552 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:49 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Took 1.02 seconds to deallocate network for instance.
Aug 09 00:58:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-4e0c8131-ea2e-4435-9a91-d7c984142067 req-efed7085-de34-4521-8179-755a297b2552 service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Detach interface failed, port_id=22385121-9085-4dc4-a154-60efde23a647, reason: Instance b907b883-5bd6-4387-bc37-a15bff3c00ff could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-787041c3-a012-47a5-b4cb-08ca5c3ebcfb req-c59389a4-f9f5-422b-8eee-c11e55704bce service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received event network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-787041c3-a012-47a5-b4cb-08ca5c3ebcfb req-c59389a4-f9f5-422b-8eee-c11e55704bce service nova] Acquiring lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-787041c3-a012-47a5-b4cb-08ca5c3ebcfb req-c59389a4-f9f5-422b-8eee-c11e55704bce service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-787041c3-a012-47a5-b4cb-08ca5c3ebcfb req-c59389a4-f9f5-422b-8eee-c11e55704bce service nova] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-787041c3-a012-47a5-b4cb-08ca5c3ebcfb req-c59389a4-f9f5-422b-8eee-c11e55704bce service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] No waiting events found dispatching network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:50 user nova-compute[72780]: WARNING nova.compute.manager [req-787041c3-a012-47a5-b4cb-08ca5c3ebcfb req-c59389a4-f9f5-422b-8eee-c11e55704bce service nova] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Received unexpected event network-vif-plugged-22385121-9085-4dc4-a154-60efde23a647 for instance with vm_state deleted and task_state None.
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:50 user nova-compute[72780]: WARNING nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_migrating.
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:50 user nova-compute[72780]: WARNING nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_migrating.
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:50 user nova-compute[72780]: WARNING nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_migrating.
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:50 user nova-compute[72780]: WARNING nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_migrating.
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:50 user nova-compute[72780]: WARNING nova.compute.manager [req-f34e1953-1aa4-48f0-a74d-fa9d87b1b8ee req-5803a3a2-d26b-4bb2-a868-22edf558843a service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_migrating.
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Deleted allocations for instance b907b883-5bd6-4387-bc37-a15bff3c00ff
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e0cf413f-51aa-4c6a-8682-296ed52ffac1 tempest-VolumesActionsTest-952031033 tempest-VolumesActionsTest-952031033-project-member] Lock "b907b883-5bd6-4387-bc37-a15bff3c00ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG nova.network.neutron [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Port 43628f21-b02e-42b7-9469-004c6be8b75a binding to destination host user is already ACTIVE {{(pid=72780) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG os_brick.utils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dbc50e-6686-4efe-8380-cbe5d577ce9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1558c52c-086f-4ee0-93d3-f1b9aebbfb40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121316b-0489-47fb-bb8f-fe52c017a56a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d23fb-7849-4b6d-b1be-ef399e27bd5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:58:51 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:58:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ba3ce-1b5f-4cbf-9d86-1f9006b4fbdf]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:58:51 user nova-compute[72780]: DEBUG os_brick.utils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:58:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "8f761825-14d1-4984-9cec-8b045fba051c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:54 user nova-compute[72780]: INFO nova.compute.manager [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Terminating instance
Aug 09 00:58:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-930af515-07f7-4ec9-976f-fd0228a191b4 req-97d8a2d3-f442-4339-b167-a81c999fe23a service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-vif-unplugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-930af515-07f7-4ec9-976f-fd0228a191b4 req-97d8a2d3-f442-4339-b167-a81c999fe23a service nova] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-930af515-07f7-4ec9-976f-fd0228a191b4 req-97d8a2d3-f442-4339-b167-a81c999fe23a service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-930af515-07f7-4ec9-976f-fd0228a191b4 req-97d8a2d3-f442-4339-b167-a81c999fe23a service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-930af515-07f7-4ec9-976f-fd0228a191b4 req-97d8a2d3-f442-4339-b167-a81c999fe23a service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] No waiting events found dispatching network-vif-unplugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-930af515-07f7-4ec9-976f-fd0228a191b4 req-97d8a2d3-f442-4339-b167-a81c999fe23a service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-vif-unplugged-bfddc3b0-2315-4817-8676-7659f371c13f for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 00:58:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Instance destroyed successfully.
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lazy-loading 'resources' on Instance uuid 8f761825-14d1-4984-9cec-8b045fba051c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1272300904',display_name='tempest-VolumesNegativeTest-instance-1272300904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1272300904',id=16,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:57:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a50679113ae047e2a63eaf6b16e323f8',ramdisk_id='',reservation_id='r-siad40ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1095462826',owner_user_name='tempest-VolumesNegativeTest-1095462826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:57:13Z,user_data=None,user_id='632f176971494c9b9b5c01a795bfd5da',uuid=8f761825-14d1-4984-9cec-8b045fba051c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Converting VIF {"id": "bfddc3b0-2315-4817-8676-7659f371c13f", "address": "fa:16:3e:c0:45:ca", "network": {"id": "9af38960-b4f1-46ec-821a-521cad510775", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b9aa823b8b2e46f8907e8be435bd146d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfddc3b0-23", "ovs_interfaceid": "bfddc3b0-2315-4817-8676-7659f371c13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG os_vif [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfddc3b0-23, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: INFO os_vif [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=bfddc3b0-2315-4817-8676-7659f371c13f,network=Network(9af38960-b4f1-46ec-821a-521cad510775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfddc3b0-23')
Aug 09 00:58:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Deleting instance files /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c_del
Aug 09 00:58:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Deletion of /opt/stack/data/nova/instances/8f761825-14d1-4984-9cec-8b045fba051c_del complete
Aug 09 00:58:55 user nova-compute[72780]: INFO nova.compute.manager [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 00:58:55 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:58:55 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:58:55 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Took 0.62 seconds to deallocate network for instance.
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:56 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Deleted allocations for instance 8f761825-14d1-4984-9cec-8b045fba051c
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a7053e33-7ef9-4d26-a816-98ce5bab4a13 tempest-VolumesNegativeTest-1095462826 tempest-VolumesNegativeTest-1095462826-project-member] Lock "8f761825-14d1-4984-9cec-8b045fba051c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] Acquiring lock "8f761825-14d1-4984-9cec-8b045fba051c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] Lock "8f761825-14d1-4984-9cec-8b045fba051c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:58:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] No waiting events found dispatching network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:58:56 user nova-compute[72780]: WARNING nova.compute.manager [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received unexpected event network-vif-plugged-bfddc3b0-2315-4817-8676-7659f371c13f for instance with vm_state deleted and task_state None.
Aug 09 00:58:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-13d480e5-4f2d-4533-a9a1-08438ca23524 req-eaf1e729-d40b-47a4-a607-4110e5590e35 service nova] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Received event network-vif-deleted-bfddc3b0-2315-4817-8676-7659f371c13f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Starting finish_migration {{(pid=72780) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 00:59:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Creating image(s)
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk. size=21474836480 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk 21474836480 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk 21474836480" returned: 0 in 0.056s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start _get_guest_xml network_info=[{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9f271642-610f-451a-b6e1-159f2cf3523c', 'attached_at': '2023-08-09T00:59:00.000000', 'detached_at': '', 'volume_id': 'cc9917b1-e23b-43f1-ae97-02dba67e4095', 'serial': 'cc9917b1-e23b-43f1-ae97-02dba67e4095'}, 'disk_bus': 'virtio', 'attachment_id': '4943be0f-bc4e-4e97-9509-7e18e9544f60', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:59:00 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:00 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:59:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:00 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8ffe34-4fa6-4a91-8fa4-3ddf6bb66da7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:59:00 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2cbf98-643d-4ceb-b18b-63f02555cab5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095] added
Aug 09 00:59:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e2542b-8eb6-45a2-8e11-3f5d6715c22c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b20690-b533-44a5-8d37-6020185d0357]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clmeZgnX {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clmeZgnX" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c27494-a4f6-4976-9c93-c34ed7f0ca04]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'clmeZgnX'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4068793d-68f6-44db-80cd-bdcf983cd4d0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e334f016-2801-43b5-9d4c-3317132aa55e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f7cd20-c489-419d-b611-52665e63080e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]
Aug 09 00:59:00 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.
Aug 09 00:59:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7c83b6-00be-4cd0-807e-65a431d651a8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e111e186-0907-4375-9474-661696f800eb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:00 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:00 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb3d055-eea4-4436-bb2e-f4411ac48dc7]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23062313039316464', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062313039316464', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:59:01 user nova-compute[72780]:   <uuid>9f271642-610f-451a-b6e1-159f2cf3523c</uuid>
Aug 09 00:59:01 user nova-compute[72780]:   <name>instance-0000000d</name>
Aug 09 00:59:01 user nova-compute[72780]:   <memory>2097152</memory>
Aug 09 00:59:01 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:59:01 user nova-compute[72780]:   <metadata>
Aug 09 00:59:01 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:59:01 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:59:01 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherB-server-1122386235</nova:name>
Aug 09 00:59:01 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:59:00</nova:creationTime>
Aug 09 00:59:01 user nova-compute[72780]:       <nova:flavor name="m1.small">
Aug 09 00:59:01 user nova-compute[72780]:         <nova:memory>2048</nova:memory>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:disk>20</nova:disk>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:59:01 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:59:01 user nova-compute[72780]:       <nova:owner>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:user uuid="70e71720a3524b229f3c2c7a327db2c8">tempest-ServerActionsTestOtherB-897270837-project-member</nova:user>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:project uuid="f4b5ecdb327a4ee98887cd048c08ca0d">tempest-ServerActionsTestOtherB-897270837</nova:project>
Aug 09 00:59:01 user nova-compute[72780]:       </nova:owner>
Aug 09 00:59:01 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:59:01 user nova-compute[72780]:       <nova:ports>
Aug 09 00:59:01 user nova-compute[72780]:         <nova:port uuid="43628f21-b02e-42b7-9469-004c6be8b75a">
Aug 09 00:59:01 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 00:59:01 user nova-compute[72780]:         </nova:port>
Aug 09 00:59:01 user nova-compute[72780]:       </nova:ports>
Aug 09 00:59:01 user nova-compute[72780]:     </nova:instance>
Aug 09 00:59:01 user nova-compute[72780]:   </metadata>
Aug 09 00:59:01 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:59:01 user nova-compute[72780]:     <system>
Aug 09 00:59:01 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:59:01 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:59:01 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:59:01 user nova-compute[72780]:       <entry name="serial">9f271642-610f-451a-b6e1-159f2cf3523c</entry>
Aug 09 00:59:01 user nova-compute[72780]:       <entry name="uuid">9f271642-610f-451a-b6e1-159f2cf3523c</entry>
Aug 09 00:59:01 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:59:01 user nova-compute[72780]:     </system>
Aug 09 00:59:01 user nova-compute[72780]:   </sysinfo>
Aug 09 00:59:01 user nova-compute[72780]:   <os>
Aug 09 00:59:01 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:59:01 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:59:01 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:59:01 user nova-compute[72780]:   </os>
Aug 09 00:59:01 user nova-compute[72780]:   <features>
Aug 09 00:59:01 user nova-compute[72780]:     <acpi/>
Aug 09 00:59:01 user nova-compute[72780]:     <apic/>
Aug 09 00:59:01 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:59:01 user nova-compute[72780]:   </features>
Aug 09 00:59:01 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:59:01 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:59:01 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:59:01 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:59:01 user nova-compute[72780]:   </clock>
Aug 09 00:59:01 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:59:01 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:59:01 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:59:01 user nova-compute[72780]:   </cpu>
Aug 09 00:59:01 user nova-compute[72780]:   <devices>
Aug 09 00:59:01 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:59:01 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:59:01 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk"/>
Aug 09 00:59:01 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:59:01 user nova-compute[72780]:     </disk>
Aug 09 00:59:01 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 00:59:01 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:59:01 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 00:59:01 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 00:59:01 user nova-compute[72780]:       <serial>cc9917b1-e23b-43f1-ae97-02dba67e4095</serial>
Aug 09 00:59:01 user nova-compute[72780]:     </disk>
Aug 09 00:59:01 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:59:01 user nova-compute[72780]:       <mac address="fa:16:3e:3a:22:77"/>
Aug 09 00:59:01 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:01 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:59:01 user nova-compute[72780]:       <target dev="tap43628f21-b0"/>
Aug 09 00:59:01 user nova-compute[72780]:     </interface>
Aug 09 00:59:01 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:59:01 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/console.log" append="off"/>
Aug 09 00:59:01 user nova-compute[72780]:     </serial>
Aug 09 00:59:01 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:59:01 user nova-compute[72780]:     <video>
Aug 09 00:59:01 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:01 user nova-compute[72780]:     </video>
Aug 09 00:59:01 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:59:01 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:59:01 user nova-compute[72780]:     </rng>
Aug 09 00:59:01 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:59:01 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:59:01 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:59:01 user nova-compute[72780]:     </memballoon>
Aug 09 00:59:01 user nova-compute[72780]:   </devices>
Aug 09 00:59:01 user nova-compute[72780]: </domain>
Aug 09 00:59:01 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-174260641-network", "vif_mac": "fa:16:3e:3a:22:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG os_vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43628f21-b0, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43628f21-b0, col_values=(('external_ids', {'iface-id': '43628f21-b02e-42b7-9469-004c6be8b75a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:22:77', 'vm-uuid': '9f271642-610f-451a-b6e1-159f2cf3523c'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:02 user nova-compute[72780]: INFO os_vif [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0')
Aug 09 00:59:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] No VIF found with MAC fa:16:3e:3a:22:77, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542728.69917, b907b883-5bd6-4387-bc37-a15bff3c00ff => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:03 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] VM Stopped (Lifecycle Event)
Aug 09 00:59:03 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542728.715261, 9f271642-610f-451a-b6e1-159f2cf3523c => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:03 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Stopped (Lifecycle Event)
Aug 09 00:59:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-85f30cac-d591-410b-ae05-697919574bef req-376af397-7bd5-4f95-b66c-5fe24d91f3a3 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-85f30cac-d591-410b-ae05-697919574bef req-376af397-7bd5-4f95-b66c-5fe24d91f3a3 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-85f30cac-d591-410b-ae05-697919574bef req-376af397-7bd5-4f95-b66c-5fe24d91f3a3 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-85f30cac-d591-410b-ae05-697919574bef req-376af397-7bd5-4f95-b66c-5fe24d91f3a3 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-85f30cac-d591-410b-ae05-697919574bef req-376af397-7bd5-4f95-b66c-5fe24d91f3a3 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:03 user nova-compute[72780]: WARNING nova.compute.manager [req-85f30cac-d591-410b-ae05-697919574bef req-376af397-7bd5-4f95-b66c-5fe24d91f3a3 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_finish.
Aug 09 00:59:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cf5f0d3d-a575-4a00-a9bf-3a0ef5cf58b6 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-399f774f-5bf1-4a1e-ad0e-77ddf7b545a8 None None] [instance: b907b883-5bd6-4387-bc37-a15bff3c00ff] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542745.6407797, 9f271642-610f-451a-b6e1-159f2cf3523c => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Resumed (Lifecycle Event)
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:59:05 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance running successfully.
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Failed to set time: agent not configured {{(pid=72780) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-912e6f5c-dadc-4147-a870-5b2b4a99ae8d tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] finish_migration finished successfully. {{(pid=72780) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542745.6430657, 9f271642-610f-451a-b6e1-159f2cf3523c => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Started (Lifecycle Event)
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-084041b5-a038-4453-9e1f-8c3c72780584 req-8d29e878-ebab-4c61-be5b-febfd9944a55 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-084041b5-a038-4453-9e1f-8c3c72780584 req-8d29e878-ebab-4c61-be5b-febfd9944a55 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-084041b5-a038-4453-9e1f-8c3c72780584 req-8d29e878-ebab-4c61-be5b-febfd9944a55 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-084041b5-a038-4453-9e1f-8c3c72780584 req-8d29e878-ebab-4c61-be5b-febfd9944a55 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-084041b5-a038-4453-9e1f-8c3c72780584 req-8d29e878-ebab-4c61-be5b-febfd9944a55 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:05 user nova-compute[72780]: WARNING nova.compute.manager [req-084041b5-a038-4453-9e1f-8c3c72780584 req-8d29e878-ebab-4c61-be5b-febfd9944a55 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state resize_finish.
Aug 09 00:59:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:10 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542735.2314482, 8f761825-14d1-4984-9cec-8b045fba051c => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:10 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] VM Stopped (Lifecycle Event)
Aug 09 00:59:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3ecde327-09be-490f-95af-32cbb521ea5e None None] [instance: 8f761825-14d1-4984-9cec-8b045fba051c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 00:59:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:59:18 user nova-compute[72780]: INFO nova.compute.claims [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Claim successful on node user
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:59:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.policy [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da43fc200f6044668eec95f723ec2486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2f203320294ed59055d5d0d3cf322a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:59:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Creating image(s)
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "/opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "/opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk 1073741824" returned: 0 in 0.053s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-changed-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Refreshing instance network info cache due to event network-changed-6ea508fa-8a89-4c69-9841-85b4769b06fe. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] Acquiring lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] Acquired lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:19 user nova-compute[72780]: DEBUG nova.network.neutron [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Refreshing network info cache for port 6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Successfully created port: 15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Cannot resize image /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lazy-loading 'migration_context' on Instance uuid e9119959-190b-4b0a-98bc-21338c7ad20b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Ensure instance console log exists: /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updated VIF entry in instance network info cache for port 6ea508fa-8a89-4c69-9841-85b4769b06fe. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updating instance_info_cache with network_info: [{"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b75f606-370f-49b0-bfff-adca25fbcc5f req-38fdb8b8-f600-4eef-ad58-f3f5ca29b7a7 service nova] Releasing lock "refresh_cache-a35ae1e9-1559-41c8-8476-d571b679c084" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:59:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Successfully updated port: 15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-changed-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Refreshing instance network info cache due to event network-changed-15e0e778-ad70-4dea-a426-d4dca9cef78b. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] Acquiring lock "refresh_cache-e9119959-190b-4b0a-98bc-21338c7ad20b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] Acquired lock "refresh_cache-e9119959-190b-4b0a-98bc-21338c7ad20b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.network.neutron [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Refreshing network info cache for port 15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "refresh_cache-e9119959-190b-4b0a-98bc-21338c7ad20b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:21 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:21 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7582MB free_disk=25.161746978759766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.network.neutron [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Applying migration context for instance 9f271642-610f-451a-b6e1-159f2cf3523c as it has an incoming, in-progress migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc. Migration status is finished {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 00:59:21 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating resource usage from migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance deec36f5-a323-4595-b87a-abc995824040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a35ae1e9-1559-41c8-8476-d571b679c084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e9119959-190b-4b0a-98bc-21338c7ad20b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.network.neutron [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d5fbc28b-fd6c-435d-9015-b41c71bfebc4 req-bf17d734-94cb-42a5-986d-7782e2cab713 service nova] Releasing lock "refresh_cache-e9119959-190b-4b0a-98bc-21338c7ad20b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquired lock "refresh_cache-e9119959-190b-4b0a-98bc-21338c7ad20b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 00:59:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Updating instance_info_cache with network_info: [{"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Releasing lock "refresh_cache-e9119959-190b-4b0a-98bc-21338c7ad20b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Instance network_info: |[{"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Start _get_guest_xml network_info=[{"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:59:22 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:22 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1028900195',display_name='tempest-VolumesActionsTest-instance-1028900195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1028900195',id=19,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2f203320294ed59055d5d0d3cf322a',ramdisk_id='',reservation_id='r-j7g8gtkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1675369655',owner_user_name='tempest-VolumesActionsTest-1675369655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:59:19Z,user_data=None,user_id='da43fc200f6044668eec95f723ec2486',uuid=e9119959-190b-4b0a-98bc-21338c7ad20b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converting VIF {"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.objects.instance [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lazy-loading 'pci_devices' on Instance uuid e9119959-190b-4b0a-98bc-21338c7ad20b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:59:22 user nova-compute[72780]:   <uuid>e9119959-190b-4b0a-98bc-21338c7ad20b</uuid>
Aug 09 00:59:22 user nova-compute[72780]:   <name>instance-00000013</name>
Aug 09 00:59:22 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:59:22 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:59:22 user nova-compute[72780]:   <metadata>
Aug 09 00:59:22 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:59:22 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:59:22 user nova-compute[72780]:       <nova:name>tempest-VolumesActionsTest-instance-1028900195</nova:name>
Aug 09 00:59:22 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:59:22</nova:creationTime>
Aug 09 00:59:22 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:59:22 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:59:22 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:59:22 user nova-compute[72780]:       <nova:owner>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:user uuid="da43fc200f6044668eec95f723ec2486">tempest-VolumesActionsTest-1675369655-project-member</nova:user>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:project uuid="ee2f203320294ed59055d5d0d3cf322a">tempest-VolumesActionsTest-1675369655</nova:project>
Aug 09 00:59:22 user nova-compute[72780]:       </nova:owner>
Aug 09 00:59:22 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:59:22 user nova-compute[72780]:       <nova:ports>
Aug 09 00:59:22 user nova-compute[72780]:         <nova:port uuid="15e0e778-ad70-4dea-a426-d4dca9cef78b">
Aug 09 00:59:22 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 00:59:22 user nova-compute[72780]:         </nova:port>
Aug 09 00:59:22 user nova-compute[72780]:       </nova:ports>
Aug 09 00:59:22 user nova-compute[72780]:     </nova:instance>
Aug 09 00:59:22 user nova-compute[72780]:   </metadata>
Aug 09 00:59:22 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:59:22 user nova-compute[72780]:     <system>
Aug 09 00:59:22 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:59:22 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:59:22 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:59:22 user nova-compute[72780]:       <entry name="serial">e9119959-190b-4b0a-98bc-21338c7ad20b</entry>
Aug 09 00:59:22 user nova-compute[72780]:       <entry name="uuid">e9119959-190b-4b0a-98bc-21338c7ad20b</entry>
Aug 09 00:59:22 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:59:22 user nova-compute[72780]:     </system>
Aug 09 00:59:22 user nova-compute[72780]:   </sysinfo>
Aug 09 00:59:22 user nova-compute[72780]:   <os>
Aug 09 00:59:22 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:59:22 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:59:22 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:59:22 user nova-compute[72780]:   </os>
Aug 09 00:59:22 user nova-compute[72780]:   <features>
Aug 09 00:59:22 user nova-compute[72780]:     <acpi/>
Aug 09 00:59:22 user nova-compute[72780]:     <apic/>
Aug 09 00:59:22 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:59:22 user nova-compute[72780]:   </features>
Aug 09 00:59:22 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:59:22 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:59:22 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:59:22 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:59:22 user nova-compute[72780]:   </clock>
Aug 09 00:59:22 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:59:22 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:59:22 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:59:22 user nova-compute[72780]:   </cpu>
Aug 09 00:59:22 user nova-compute[72780]:   <devices>
Aug 09 00:59:22 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:59:22 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:59:22 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk"/>
Aug 09 00:59:22 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:59:22 user nova-compute[72780]:     </disk>
Aug 09 00:59:22 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:59:22 user nova-compute[72780]:       <mac address="fa:16:3e:4d:66:96"/>
Aug 09 00:59:22 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:22 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:59:22 user nova-compute[72780]:       <target dev="tap15e0e778-ad"/>
Aug 09 00:59:22 user nova-compute[72780]:     </interface>
Aug 09 00:59:22 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:59:22 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/console.log" append="off"/>
Aug 09 00:59:22 user nova-compute[72780]:     </serial>
Aug 09 00:59:22 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:59:22 user nova-compute[72780]:     <video>
Aug 09 00:59:22 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:22 user nova-compute[72780]:     </video>
Aug 09 00:59:22 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:59:22 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:59:22 user nova-compute[72780]:     </rng>
Aug 09 00:59:22 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:59:22 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:59:22 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:59:22 user nova-compute[72780]:     </memballoon>
Aug 09 00:59:22 user nova-compute[72780]:   </devices>
Aug 09 00:59:22 user nova-compute[72780]: </domain>
Aug 09 00:59:22 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1028900195',display_name='tempest-VolumesActionsTest-instance-1028900195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1028900195',id=19,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2f203320294ed59055d5d0d3cf322a',ramdisk_id='',reservation_id='r-j7g8gtkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1675369655',owner_user_name='tempest-VolumesActionsTest-1675369655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:59:19Z,user_data=None,user_id='da43fc200f6044668eec95f723ec2486',uuid=e9119959-190b-4b0a-98bc-21338c7ad20b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converting VIF {"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG os_vif [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e0e778-ad, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15e0e778-ad, col_values=(('external_ids', {'iface-id': '15e0e778-ad70-4dea-a426-d4dca9cef78b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:66:96', 'vm-uuid': 'e9119959-190b-4b0a-98bc-21338c7ad20b'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:22 user nova-compute[72780]: INFO os_vif [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad')
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] No VIF found with MAC fa:16:3e:4d:66:96, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-78c6b6b1-90b4-456f-9de1-881aa9348278 req-06e16745-29ae-4fd7-99cc-b87614beaf9a service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-78c6b6b1-90b4-456f-9de1-881aa9348278 req-06e16745-29ae-4fd7-99cc-b87614beaf9a service nova] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-78c6b6b1-90b4-456f-9de1-881aa9348278 req-06e16745-29ae-4fd7-99cc-b87614beaf9a service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-78c6b6b1-90b4-456f-9de1-881aa9348278 req-06e16745-29ae-4fd7-99cc-b87614beaf9a service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-78c6b6b1-90b4-456f-9de1-881aa9348278 req-06e16745-29ae-4fd7-99cc-b87614beaf9a service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] No waiting events found dispatching network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:23 user nova-compute[72780]: WARNING nova.compute.manager [req-78c6b6b1-90b4-456f-9de1-881aa9348278 req-06e16745-29ae-4fd7-99cc-b87614beaf9a service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received unexpected event network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b for instance with vm_state building and task_state spawning.
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:23 user nova-compute[72780]: INFO nova.compute.manager [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Attaching volume 9739ea2e-4b04-4f39-aa42-c9214096b529 to /dev/vdb
Aug 09 00:59:24 user nova-compute[72780]: DEBUG os_brick.utils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770f989-731a-4111-97d9-1b5a962c0bf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[177b3a45-8740-40d0-8e7e-ecda0eeb22c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b66e0-ed74-48a4-b861-9cbb056b112f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20325e6-9f13-4774-ab9e-610f3c21c1d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:59:24 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:59:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b4222-b169-480b-b506-6e954ac52e8b]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG os_brick.utils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updating existing volume attachment record: e0b7a404-8cbb-4fd8-bf3e-3134a794cef1 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquired lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'info_cache' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Releasing lock "refresh_cache-1928c3a6-c836-4487-bc21-5eb902fb61fa" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance destroyed successfully.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'resources' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG os_vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc2b5d5d-b7, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:59:25 user nova-compute[72780]: INFO os_vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7')
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start _get_guest_xml network_info=[{"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'numa_topology' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'pci_devices' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:59:25 user nova-compute[72780]:   <uuid>1928c3a6-c836-4487-bc21-5eb902fb61fa</uuid>
Aug 09 00:59:25 user nova-compute[72780]:   <name>instance-00000004</name>
Aug 09 00:59:25 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:59:25 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:59:25 user nova-compute[72780]:   <metadata>
Aug 09 00:59:25 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:59:25 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:59:25 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeTestJSON-server-1294527405</nova:name>
Aug 09 00:59:25 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:59:25</nova:creationTime>
Aug 09 00:59:25 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:59:25 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:59:25 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:59:25 user nova-compute[72780]:       <nova:owner>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:user uuid="3f38504b4e824e7ea66ab9e8c56f0b50">tempest-AttachVolumeTestJSON-760573544-project-member</nova:user>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:project uuid="32ce26fa1a3947488856bfd876571471">tempest-AttachVolumeTestJSON-760573544</nova:project>
Aug 09 00:59:25 user nova-compute[72780]:       </nova:owner>
Aug 09 00:59:25 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:59:25 user nova-compute[72780]:       <nova:ports>
Aug 09 00:59:25 user nova-compute[72780]:         <nova:port uuid="fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2">
Aug 09 00:59:25 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 00:59:25 user nova-compute[72780]:         </nova:port>
Aug 09 00:59:25 user nova-compute[72780]:       </nova:ports>
Aug 09 00:59:25 user nova-compute[72780]:     </nova:instance>
Aug 09 00:59:25 user nova-compute[72780]:   </metadata>
Aug 09 00:59:25 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:59:25 user nova-compute[72780]:     <system>
Aug 09 00:59:25 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:59:25 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:59:25 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:59:25 user nova-compute[72780]:       <entry name="serial">1928c3a6-c836-4487-bc21-5eb902fb61fa</entry>
Aug 09 00:59:25 user nova-compute[72780]:       <entry name="uuid">1928c3a6-c836-4487-bc21-5eb902fb61fa</entry>
Aug 09 00:59:25 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:59:25 user nova-compute[72780]:     </system>
Aug 09 00:59:25 user nova-compute[72780]:   </sysinfo>
Aug 09 00:59:25 user nova-compute[72780]:   <os>
Aug 09 00:59:25 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:59:25 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:59:25 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:59:25 user nova-compute[72780]:   </os>
Aug 09 00:59:25 user nova-compute[72780]:   <features>
Aug 09 00:59:25 user nova-compute[72780]:     <acpi/>
Aug 09 00:59:25 user nova-compute[72780]:     <apic/>
Aug 09 00:59:25 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:59:25 user nova-compute[72780]:   </features>
Aug 09 00:59:25 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:59:25 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:59:25 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:59:25 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:59:25 user nova-compute[72780]:   </clock>
Aug 09 00:59:25 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:59:25 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:59:25 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:59:25 user nova-compute[72780]:   </cpu>
Aug 09 00:59:25 user nova-compute[72780]:   <devices>
Aug 09 00:59:25 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:59:25 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:59:25 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk"/>
Aug 09 00:59:25 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:59:25 user nova-compute[72780]:     </disk>
Aug 09 00:59:25 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:59:25 user nova-compute[72780]:       <mac address="fa:16:3e:cb:2c:84"/>
Aug 09 00:59:25 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:25 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:59:25 user nova-compute[72780]:       <target dev="tapfc2b5d5d-b7"/>
Aug 09 00:59:25 user nova-compute[72780]:     </interface>
Aug 09 00:59:25 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:59:25 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/console.log" append="off"/>
Aug 09 00:59:25 user nova-compute[72780]:     </serial>
Aug 09 00:59:25 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:59:25 user nova-compute[72780]:     <video>
Aug 09 00:59:25 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:25 user nova-compute[72780]:     </video>
Aug 09 00:59:25 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:59:25 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:59:25 user nova-compute[72780]:     </rng>
Aug 09 00:59:25 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:59:25 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:59:25 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:59:25 user nova-compute[72780]:     </memballoon>
Aug 09 00:59:25 user nova-compute[72780]:   </devices>
Aug 09 00:59:25 user nova-compute[72780]: </domain>
Aug 09 00:59:25 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542765.6904156, e9119959-190b-4b0a-98bc-21338c7ad20b => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] VM Resumed (Lifecycle Event)
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Instance spawned successfully.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542765.6910121, e9119959-190b-4b0a-98bc-21338c7ad20b => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] VM Started (Lifecycle Event)
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-7e4f4db7-5d37-48ee-8392-4e373f0e4354 req-8db4d46f-7b63-4717-9dc6-d59c6c4493a7 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7e4f4db7-5d37-48ee-8392-4e373f0e4354 req-8db4d46f-7b63-4717-9dc6-d59c6c4493a7 service nova] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7e4f4db7-5d37-48ee-8392-4e373f0e4354 req-8db4d46f-7b63-4717-9dc6-d59c6c4493a7 service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7e4f4db7-5d37-48ee-8392-4e373f0e4354 req-8db4d46f-7b63-4717-9dc6-d59c6c4493a7 service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-7e4f4db7-5d37-48ee-8392-4e373f0e4354 req-8db4d46f-7b63-4717-9dc6-d59c6c4493a7 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] No waiting events found dispatching network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:25 user nova-compute[72780]: WARNING nova.compute.manager [req-7e4f4db7-5d37-48ee-8392-4e373f0e4354 req-8db4d46f-7b63-4717-9dc6-d59c6c4493a7 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received unexpected event network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b for instance with vm_state building and task_state spawning.
Aug 09 00:59:25 user nova-compute[72780]: INFO nova.compute.manager [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Took 7.33 seconds to build instance.
Aug 09 00:59:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97cba652-1029-4a6e-8917-446ded97bf11 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.446s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Cannot resize image /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'migration_context' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG os_vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc2b5d5d-b7, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc2b5d5d-b7, col_values=(('external_ids', {'iface-id': 'fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:2c:84', 'vm-uuid': '1928c3a6-c836-4487-bc21-5eb902fb61fa'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:59:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:26 user nova-compute[72780]: INFO os_vif [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7')
Aug 09 00:59:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-changed-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Refreshing instance network info cache due to event network-changed-a45ab989-5763-466b-b942-8c998e5c36e1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] Acquiring lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] Acquired lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG nova.network.neutron [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Refreshing network info cache for port a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'flavor' on Instance uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:28 user nova-compute[72780]: INFO nova.compute.manager [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Attaching volume 0425dc29-9cf8-4e24-af60-8aa3136ea583 to /dev/vdb
Aug 09 00:59:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-b10a5235-2dc1-4cd7-b52e-00e6da528ab5 req-7696e359-92ad-4d6d-a074-6d94305b363a service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b10a5235-2dc1-4cd7-b52e-00e6da528ab5 req-7696e359-92ad-4d6d-a074-6d94305b363a service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b10a5235-2dc1-4cd7-b52e-00e6da528ab5 req-7696e359-92ad-4d6d-a074-6d94305b363a service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b10a5235-2dc1-4cd7-b52e-00e6da528ab5 req-7696e359-92ad-4d6d-a074-6d94305b363a service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-b10a5235-2dc1-4cd7-b52e-00e6da528ab5 req-7696e359-92ad-4d6d-a074-6d94305b363a service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:28 user nova-compute[72780]: WARNING nova.compute.manager [req-b10a5235-2dc1-4cd7-b52e-00e6da528ab5 req-7696e359-92ad-4d6d-a074-6d94305b363a service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state powering-on.
Aug 09 00:59:28 user nova-compute[72780]: DEBUG os_brick.utils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88d3d0b-7404-4ef4-8350-16b3db8ed6cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG nova.network.neutron [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updated VIF entry in instance network info cache for port a45ab989-5763-466b-b942-8c998e5c36e1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG nova.network.neutron [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating instance_info_cache with network_info: [{"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.043s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e7148-0ac9-4cd4-8eab-2facfed2fc39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[666941c0-375e-4163-ba38-bdb4f7bc20cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d45f0d45-ec5d-496e-9ca7-5dd46148f9f5 req-7ced77d5-c4b9-4435-9751-f531c1272174 service nova] Releasing lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb4e7f-f893-4adb-a06d-60f7aee3681b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 00:59:28 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 00:59:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c11f792-cdeb-4280-9ff5-673076e8665b]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG os_brick.utils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating existing volume attachment record: 642ad056-caff-442a-a38b-deb5a7662de4 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "83789356-a9ab-43ad-8701-376569301904" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "83789356-a9ab-43ad-8701-376569301904" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:59:30 user nova-compute[72780]: INFO nova.compute.claims [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Claim successful on node user
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-f6ad60d0-1e37-4ed2-9dc2-0bdbfd9fc15b req-420824f8-ab2f-422d-b48a-75d4546fe256 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6ad60d0-1e37-4ed2-9dc2-0bdbfd9fc15b req-420824f8-ab2f-422d-b48a-75d4546fe256 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6ad60d0-1e37-4ed2-9dc2-0bdbfd9fc15b req-420824f8-ab2f-422d-b48a-75d4546fe256 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6ad60d0-1e37-4ed2-9dc2-0bdbfd9fc15b req-420824f8-ab2f-422d-b48a-75d4546fe256 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-f6ad60d0-1e37-4ed2-9dc2-0bdbfd9fc15b req-420824f8-ab2f-422d-b48a-75d4546fe256 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:30 user nova-compute[72780]: WARNING nova.compute.manager [req-f6ad60d0-1e37-4ed2-9dc2-0bdbfd9fc15b req-420824f8-ab2f-422d-b48a-75d4546fe256 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state stopped and task_state powering-on.
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542770.3242111, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Resumed (Lifecycle Event)
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance rebooted successfully.
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c5ca6a40-b5b7-4799-92b6-2a2b0984c00f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542770.325841, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Started (Lifecycle Event)
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:59:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:59:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.policy [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee86238cbadd465a8d45b72b20b8f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1fde5f8ef464f538a9dc70257e30863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:59:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Creating image(s)
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "/opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "/opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "/opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk 1073741824" returned: 0 in 0.061s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Successfully created port: c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Cannot resize image /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'migration_context' on Instance uuid 83789356-a9ab-43ad-8701-376569301904 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Ensure instance console log exists: /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Successfully updated port: c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "refresh_cache-83789356-a9ab-43ad-8701-376569301904" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquired lock "refresh_cache-83789356-a9ab-43ad-8701-376569301904" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-changed-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Refreshing instance network info cache due to event network-changed-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] Acquiring lock "refresh_cache-83789356-a9ab-43ad-8701-376569301904" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSqNzBwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:59:33 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:33 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:33 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[17930437-3b02-4a3a-b9f0-5d606df59244]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:59:33 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e760226-9d69-4870-8b7d-4f6aa46b95d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529] added
Aug 09 00:59:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5354e544-1617-4c34-9314-5acf486162e5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00dbcf-bab9-4429-8b8f-328e98477c00]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSqNzBwC {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSqNzBwC" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74b2ab-952c-4c0d-8b44-673fa0fcb887]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FSqNzBwC'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35999100-b1fc-4a7f-8789-4efe63b4b494]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd94cd98-1c29-49e5-86ce-af58f4493f47]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:33 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:33 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Updating instance_info_cache with network_info: [{"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Releasing lock "refresh_cache-83789356-a9ab-43ad-8701-376569301904" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Instance network_info: |[{"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] Acquired lock "refresh_cache-83789356-a9ab-43ad-8701-376569301904" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Refreshing network info cache for port c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Start _get_guest_xml network_info=[{"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af16d76-debb-4fe6-a01b-3113d3d77b26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260]
Aug 09 00:59:33 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260] successful.
Aug 09 00:59:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:33 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fac797-492f-46c0-81c7-38488b879b50]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-420031786',display_name='tempest-VolumesAdminNegativeTest-server-420031786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-420031786',id=20,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1fde5f8ef464f538a9dc70257e30863',ramdisk_id='',reservation_id='r-jlq1v4yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-347119394',owner_user_name='tempest-VolumesAdminNegativeTest-347119394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:59:31Z,user_data=None,user_id='ee86238cbadd465a8d45b72b20b8f50d',uuid=83789356-a9ab-43ad-8701-376569301904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converting VIF {"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'pci_devices' on Instance uuid 83789356-a9ab-43ad-8701-376569301904 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e38938-a73e-4c44-a1f0-7ee8c2d22101]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:33 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:33 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:33 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:33 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:59:33 user nova-compute[72780]:   <uuid>83789356-a9ab-43ad-8701-376569301904</uuid>
Aug 09 00:59:33 user nova-compute[72780]:   <name>instance-00000014</name>
Aug 09 00:59:33 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:59:33 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:59:33 user nova-compute[72780]:   <metadata>
Aug 09 00:59:33 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:59:33 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:59:33 user nova-compute[72780]:       <nova:name>tempest-VolumesAdminNegativeTest-server-420031786</nova:name>
Aug 09 00:59:33 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:59:33</nova:creationTime>
Aug 09 00:59:33 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:59:33 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:59:33 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:59:33 user nova-compute[72780]:       <nova:owner>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:user uuid="ee86238cbadd465a8d45b72b20b8f50d">tempest-VolumesAdminNegativeTest-347119394-project-member</nova:user>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:project uuid="c1fde5f8ef464f538a9dc70257e30863">tempest-VolumesAdminNegativeTest-347119394</nova:project>
Aug 09 00:59:33 user nova-compute[72780]:       </nova:owner>
Aug 09 00:59:33 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:59:33 user nova-compute[72780]:       <nova:ports>
Aug 09 00:59:33 user nova-compute[72780]:         <nova:port uuid="c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab">
Aug 09 00:59:33 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 00:59:33 user nova-compute[72780]:         </nova:port>
Aug 09 00:59:33 user nova-compute[72780]:       </nova:ports>
Aug 09 00:59:33 user nova-compute[72780]:     </nova:instance>
Aug 09 00:59:33 user nova-compute[72780]:   </metadata>
Aug 09 00:59:33 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:59:33 user nova-compute[72780]:     <system>
Aug 09 00:59:33 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:59:33 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:59:33 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:59:33 user nova-compute[72780]:       <entry name="serial">83789356-a9ab-43ad-8701-376569301904</entry>
Aug 09 00:59:33 user nova-compute[72780]:       <entry name="uuid">83789356-a9ab-43ad-8701-376569301904</entry>
Aug 09 00:59:33 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:59:33 user nova-compute[72780]:     </system>
Aug 09 00:59:33 user nova-compute[72780]:   </sysinfo>
Aug 09 00:59:33 user nova-compute[72780]:   <os>
Aug 09 00:59:33 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:59:33 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:59:33 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:59:33 user nova-compute[72780]:   </os>
Aug 09 00:59:33 user nova-compute[72780]:   <features>
Aug 09 00:59:33 user nova-compute[72780]:     <acpi/>
Aug 09 00:59:33 user nova-compute[72780]:     <apic/>
Aug 09 00:59:33 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:59:33 user nova-compute[72780]:   </features>
Aug 09 00:59:33 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:59:33 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:59:33 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:59:33 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:59:33 user nova-compute[72780]:   </clock>
Aug 09 00:59:33 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:59:33 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:59:33 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:59:33 user nova-compute[72780]:   </cpu>
Aug 09 00:59:33 user nova-compute[72780]:   <devices>
Aug 09 00:59:33 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:59:33 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:59:33 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk"/>
Aug 09 00:59:33 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:59:33 user nova-compute[72780]:     </disk>
Aug 09 00:59:33 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:59:33 user nova-compute[72780]:       <mac address="fa:16:3e:e4:92:67"/>
Aug 09 00:59:33 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:33 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:59:33 user nova-compute[72780]:       <target dev="tapc0bd4dc2-2e"/>
Aug 09 00:59:33 user nova-compute[72780]:     </interface>
Aug 09 00:59:33 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:59:33 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/console.log" append="off"/>
Aug 09 00:59:33 user nova-compute[72780]:     </serial>
Aug 09 00:59:33 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:59:33 user nova-compute[72780]:     <video>
Aug 09 00:59:33 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:33 user nova-compute[72780]:     </video>
Aug 09 00:59:33 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:59:33 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:59:33 user nova-compute[72780]:     </rng>
Aug 09 00:59:33 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:59:33 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:59:33 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:59:33 user nova-compute[72780]:     </memballoon>
Aug 09 00:59:33 user nova-compute[72780]:   </devices>
Aug 09 00:59:33 user nova-compute[72780]: </domain>
Aug 09 00:59:33 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-420031786',display_name='tempest-VolumesAdminNegativeTest-server-420031786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-420031786',id=20,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1fde5f8ef464f538a9dc70257e30863',ramdisk_id='',reservation_id='r-jlq1v4yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-347119394',owner_user_name='tempest-VolumesAdminNegativeTest-347119394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:59:31Z,user_data=None,user_id='ee86238cbadd465a8d45b72b20b8f50d',uuid=83789356-a9ab-43ad-8701-376569301904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converting VIF {"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_vif [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ac644-7fe7-46da-a862-d35b9229561d]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSqNzBwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0bd4dc2-2e, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0bd4dc2-2e, col_values=(('external_ids', {'iface-id': 'c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:92:67', 'vm-uuid': '83789356-a9ab-43ad-8701-376569301904'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:33 user nova-compute[72780]: INFO os_vif [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e')
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] No VIF found with MAC fa:16:3e:e4:92:67, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Updated VIF entry in instance network info cache for port c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Updating instance_info_cache with network_info: [{"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-de471651-15c7-4f0a-a6ae-9e2f04545c50 req-8484cae3-2754-4c56-98b1-10d8aa34b45b service nova] Releasing lock "refresh_cache-83789356-a9ab-43ad-8701-376569301904" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26237373732613563', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237373732613563', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:59:34 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:59:34 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 00:59:34 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:59:34 user nova-compute[72780]:   <serial>9739ea2e-4b04-4f39-aa42-c9214096b529</serial>
Aug 09 00:59:34 user nova-compute[72780]: </disk>
Aug 09 00:59:34 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-67644059-90db-41a6-ab98-deb13d1e11c6 req-26929013-1f86-48e7-8b95-76c788657c11 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-67644059-90db-41a6-ab98-deb13d1e11c6 req-26929013-1f86-48e7-8b95-76c788657c11 service nova] Acquiring lock "83789356-a9ab-43ad-8701-376569301904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-67644059-90db-41a6-ab98-deb13d1e11c6 req-26929013-1f86-48e7-8b95-76c788657c11 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-67644059-90db-41a6-ab98-deb13d1e11c6 req-26929013-1f86-48e7-8b95-76c788657c11 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-67644059-90db-41a6-ab98-deb13d1e11c6 req-26929013-1f86-48e7-8b95-76c788657c11 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] No waiting events found dispatching network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:35 user nova-compute[72780]: WARNING nova.compute.manager [req-67644059-90db-41a6-ab98-deb13d1e11c6 req-26929013-1f86-48e7-8b95-76c788657c11 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received unexpected event network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab for instance with vm_state building and task_state spawning.
Aug 09 00:59:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:14:84:20, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e390afe0-bd30-4665-99dd-788055332bee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.403s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-ed2df508-5465-4ac5-b6d3-9acc85f1de82 req-037a348c-8beb-44cc-82ed-023132b5c0e7 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ed2df508-5465-4ac5-b6d3-9acc85f1de82 req-037a348c-8beb-44cc-82ed-023132b5c0e7 service nova] Acquiring lock "83789356-a9ab-43ad-8701-376569301904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ed2df508-5465-4ac5-b6d3-9acc85f1de82 req-037a348c-8beb-44cc-82ed-023132b5c0e7 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ed2df508-5465-4ac5-b6d3-9acc85f1de82 req-037a348c-8beb-44cc-82ed-023132b5c0e7 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-ed2df508-5465-4ac5-b6d3-9acc85f1de82 req-037a348c-8beb-44cc-82ed-023132b5c0e7 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] No waiting events found dispatching network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:37 user nova-compute[72780]: WARNING nova.compute.manager [req-ed2df508-5465-4ac5-b6d3-9acc85f1de82 req-037a348c-8beb-44cc-82ed-023132b5c0e7 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received unexpected event network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab for instance with vm_state building and task_state spawning.
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542777.6232874, 83789356-a9ab-43ad-8701-376569301904 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] VM Resumed (Lifecycle Event)
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 83789356-a9ab-43ad-8701-376569301904] Instance spawned successfully.
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542777.624816, 83789356-a9ab-43ad-8701-376569301904 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] VM Started (Lifecycle Event)
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 09 00:59:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:37 user nova-compute[72780]: INFO nova.compute.manager [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Took 7.69 seconds to build instance.
Aug 09 00:59:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-12db90ef-ce77-4871-a61a-6dcbf579bf60 tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "83789356-a9ab-43ad-8701-376569301904" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.824s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqVYpZfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:59:38 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:38 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:38 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f1fd8e-67d7-4364-947a-584bf7ee7bb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 00:59:38 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b9f2e-e834-4c79-a203-9100d2d4ddd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583] added
Aug 09 00:59:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2016b9-8ef5-4cce-985e-1fb62579aba2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef96ba-9a78-47ca-b6a9-e29c0138e699]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqVYpZfx {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqVYpZfx" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7003540e-2f0a-4024-a241-8efe74d82116]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nqVYpZfx'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02266e5-0b1e-4cec-8fba-069bec42843a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecec753-3abc-4e4c-a234-5e065cd13434]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc52e47e-89d8-4e0a-b3c9-8f30685fefdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260]
Aug 09 00:59:38 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260] successful.
Aug 09 00:59:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[065bc492-7625-4fff-900e-097629b7fb52]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c927f5-dc8c-49f9-bf12-855b710ad234]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 (non-flash)
Aug 09 00:59:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade30b3-7568-4f40-a76f-c9a0be71ed1c]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 00:59:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqVYpZfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 00:59:39 user nova-compute[72780]: INFO nova.compute.claims [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Claim successful on node user
Aug 09 00:59:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23231393430653439', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393430653439', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'flavor' on Instance uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 00:59:39 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:59:39 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 00:59:39 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:59:39 user nova-compute[72780]:   <serial>0425dc29-9cf8-4e24-af60-8aa3136ea583</serial>
Aug 09 00:59:39 user nova-compute[72780]: </disk>
Aug 09 00:59:39 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 00:59:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.policy [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0456a39aaa64bdca5df6a3b67ea9d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0bd68653554fafa823eacae86e21a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 00:59:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Creating image(s)
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] No VIF found with MAC fa:16:3e:4e:e4:0e, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-238a2b1e-2122-4e03-bdeb-26ea15685da4 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.279s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.182s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk 1073741824" returned: 0 in 0.056s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.171s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 00:59:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Successfully created port: c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Cannot resize image /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'migration_context' on Instance uuid 7ec77892-5c0c-4599-9533-3d8628c4c3f9 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Ensure instance console log exists: /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Successfully updated port: c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquired lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-changed-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Refreshing instance network info cache due to event network-changed-c52d0609-22d2-4cd8-9545-bbf8bd7b1683. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] Acquiring lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 00:59:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Updating instance_info_cache with network_info: [{"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Releasing lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Instance network_info: |[{"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] Acquired lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.neutron [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Refreshing network info cache for port c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Start _get_guest_xml network_info=[{"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 00:59:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-861012165',display_name='tempest-AttachVolumeNegativeTest-server-861012165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-861012165',id=21,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfDsczrdcYhjrhhfL2q9DXcDW2RByFxcPhXXm3t5eWzg27Sq0Khz4t4WRpTp8VNhsThZhiDFViDUVBYbiNu/6GU550IM/cK3Qw8PK4GUg7hEo8VZ0EP7wrQB4GSbSHl9w==',key_name='tempest-keypair-74257555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-axexh0pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=7ec77892-5c0c-4599-9533-3d8628c4c3f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ec77892-5c0c-4599-9533-3d8628c4c3f9 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 00:59:42 user nova-compute[72780]:   <uuid>7ec77892-5c0c-4599-9533-3d8628c4c3f9</uuid>
Aug 09 00:59:42 user nova-compute[72780]:   <name>instance-00000015</name>
Aug 09 00:59:42 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 00:59:42 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 00:59:42 user nova-compute[72780]:   <metadata>
Aug 09 00:59:42 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 00:59:42 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 00:59:42 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeNegativeTest-server-861012165</nova:name>
Aug 09 00:59:42 user nova-compute[72780]:       <nova:creationTime>2023-08-09 00:59:42</nova:creationTime>
Aug 09 00:59:42 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 00:59:42 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 00:59:42 user nova-compute[72780]:       </nova:flavor>
Aug 09 00:59:42 user nova-compute[72780]:       <nova:owner>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:user uuid="f0456a39aaa64bdca5df6a3b67ea9d68">tempest-AttachVolumeNegativeTest-1434038909-project-member</nova:user>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:project uuid="dd0bd68653554fafa823eacae86e21a0">tempest-AttachVolumeNegativeTest-1434038909</nova:project>
Aug 09 00:59:42 user nova-compute[72780]:       </nova:owner>
Aug 09 00:59:42 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 00:59:42 user nova-compute[72780]:       <nova:ports>
Aug 09 00:59:42 user nova-compute[72780]:         <nova:port uuid="c52d0609-22d2-4cd8-9545-bbf8bd7b1683">
Aug 09 00:59:42 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 00:59:42 user nova-compute[72780]:         </nova:port>
Aug 09 00:59:42 user nova-compute[72780]:       </nova:ports>
Aug 09 00:59:42 user nova-compute[72780]:     </nova:instance>
Aug 09 00:59:42 user nova-compute[72780]:   </metadata>
Aug 09 00:59:42 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 00:59:42 user nova-compute[72780]:     <system>
Aug 09 00:59:42 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 00:59:42 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 00:59:42 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 00:59:42 user nova-compute[72780]:       <entry name="serial">7ec77892-5c0c-4599-9533-3d8628c4c3f9</entry>
Aug 09 00:59:42 user nova-compute[72780]:       <entry name="uuid">7ec77892-5c0c-4599-9533-3d8628c4c3f9</entry>
Aug 09 00:59:42 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 00:59:42 user nova-compute[72780]:     </system>
Aug 09 00:59:42 user nova-compute[72780]:   </sysinfo>
Aug 09 00:59:42 user nova-compute[72780]:   <os>
Aug 09 00:59:42 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 00:59:42 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 00:59:42 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 00:59:42 user nova-compute[72780]:   </os>
Aug 09 00:59:42 user nova-compute[72780]:   <features>
Aug 09 00:59:42 user nova-compute[72780]:     <acpi/>
Aug 09 00:59:42 user nova-compute[72780]:     <apic/>
Aug 09 00:59:42 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 00:59:42 user nova-compute[72780]:   </features>
Aug 09 00:59:42 user nova-compute[72780]:   <clock offset="utc">
Aug 09 00:59:42 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 00:59:42 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 00:59:42 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 00:59:42 user nova-compute[72780]:   </clock>
Aug 09 00:59:42 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 00:59:42 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 00:59:42 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 00:59:42 user nova-compute[72780]:   </cpu>
Aug 09 00:59:42 user nova-compute[72780]:   <devices>
Aug 09 00:59:42 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 00:59:42 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 00:59:42 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk"/>
Aug 09 00:59:42 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 00:59:42 user nova-compute[72780]:     </disk>
Aug 09 00:59:42 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 00:59:42 user nova-compute[72780]:       <mac address="fa:16:3e:32:fa:b6"/>
Aug 09 00:59:42 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:42 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 00:59:42 user nova-compute[72780]:       <target dev="tapc52d0609-22"/>
Aug 09 00:59:42 user nova-compute[72780]:     </interface>
Aug 09 00:59:42 user nova-compute[72780]:     <serial type="pty">
Aug 09 00:59:42 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/console.log" append="off"/>
Aug 09 00:59:42 user nova-compute[72780]:     </serial>
Aug 09 00:59:42 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 00:59:42 user nova-compute[72780]:     <video>
Aug 09 00:59:42 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 00:59:42 user nova-compute[72780]:     </video>
Aug 09 00:59:42 user nova-compute[72780]:     <rng model="virtio">
Aug 09 00:59:42 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 00:59:42 user nova-compute[72780]:     </rng>
Aug 09 00:59:42 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 00:59:42 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 00:59:42 user nova-compute[72780]:       <stats period="10"/>
Aug 09 00:59:42 user nova-compute[72780]:     </memballoon>
Aug 09 00:59:42 user nova-compute[72780]:   </devices>
Aug 09 00:59:42 user nova-compute[72780]: </domain>
Aug 09 00:59:42 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-861012165',display_name='tempest-AttachVolumeNegativeTest-server-861012165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-861012165',id=21,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfDsczrdcYhjrhhfL2q9DXcDW2RByFxcPhXXm3t5eWzg27Sq0Khz4t4WRpTp8VNhsThZhiDFViDUVBYbiNu/6GU550IM/cK3Qw8PK4GUg7hEo8VZ0EP7wrQB4GSbSHl9w==',key_name='tempest-keypair-74257555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-axexh0pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T00:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=7ec77892-5c0c-4599-9533-3d8628c4c3f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG os_vif [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc52d0609-22, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc52d0609-22, col_values=(('external_ids', {'iface-id': 'c52d0609-22d2-4cd8-9545-bbf8bd7b1683', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:fa:b6', 'vm-uuid': '7ec77892-5c0c-4599-9533-3d8628c4c3f9'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:42 user nova-compute[72780]: INFO os_vif [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22')
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:32:fa:b6, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:42 user nova-compute[72780]: INFO nova.compute.manager [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Detaching volume 0425dc29-9cf8-4e24-af60-8aa3136ea583
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.neutron [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Updated VIF entry in instance network info cache for port c52d0609-22d2-4cd8-9545-bbf8bd7b1683. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.network.neutron [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Updating instance_info_cache with network_info: [{"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f285f12-8c89-4723-8951-3cc536125312 req-5fe6f428-5daa-403e-a9b8-bfdf62809515 service nova] Releasing lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 00:59:42 user nova-compute[72780]: INFO nova.virt.block_device [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Attempting to driver detach volume 0425dc29-9cf8-4e24-af60-8aa3136ea583 from mountpoint /dev/vdb
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Attempting to detach device vdb from instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:59:42 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:59:42 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 00:59:42 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:59:42 user nova-compute[72780]:   <serial>0425dc29-9cf8-4e24-af60-8aa3136ea583</serial>
Aug 09 00:59:42 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:59:42 user nova-compute[72780]: </disk>
Aug 09 00:59:42 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:59:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully detached device vdb from instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 from the persistent domain config.
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 00:59:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 00:59:42 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 00:59:42 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 00:59:42 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 00:59:42 user nova-compute[72780]:   <serial>0425dc29-9cf8-4e24-af60-8aa3136ea583</serial>
Aug 09 00:59:42 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 00:59:42 user nova-compute[72780]: </disk>
Aug 09 00:59:42 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542783.4735231, 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 00:59:43 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully detached device vdb from instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 from the live domain config.
Aug 09 00:59:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqVYpZfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 00:59:43 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a8174-7ac8-46cd-a68d-3fcb48fefebf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe69fe9-90b0-473b-89eb-160f86328369]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:43 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:43 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:43 user nova-compute[72780]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 (non-flash)
Aug 09 00:59:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 00:59:43 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 00:59:43 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 00:59:43 user nova-compute[72780]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 (non-flash)
Aug 09 00:59:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ad81749d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[122dc6a2-922e-4932-889a-d547471bd39a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac217b2-cb3f-4b61-80e7-2019ffc993c7]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641e6e5-275e-4d94-8e27-778f19f99ce4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21c4ceb-02f6-4980-a7a8-ad57ecbd3f7c]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd738e2f-ec31-41d5-b14d-202bdf738cf0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1b9762-9bf5-46af-966e-6422a9a1359b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260]
Aug 09 00:59:43 user nova-compute[72780]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583, portal: 172.16.0.220,3260] successful.
Aug 09 00:59:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0425dc29-9cf8-4e24-af60-8aa3136ea583 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d54bfb-10a1-49e0-b75e-ef5481310be1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] <== disconnect_volume: return (333ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 00:59:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-cb548737-7c94-4ead-b4d5-4e4af873ad17 req-5736d7ec-9634-4dc5-98b0-537b7b0358d3 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cb548737-7c94-4ead-b4d5-4e4af873ad17 req-5736d7ec-9634-4dc5-98b0-537b7b0358d3 service nova] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cb548737-7c94-4ead-b4d5-4e4af873ad17 req-5736d7ec-9634-4dc5-98b0-537b7b0358d3 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cb548737-7c94-4ead-b4d5-4e4af873ad17 req-5736d7ec-9634-4dc5-98b0-537b7b0358d3 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-cb548737-7c94-4ead-b4d5-4e4af873ad17 req-5736d7ec-9634-4dc5-98b0-537b7b0358d3 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] No waiting events found dispatching network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:44 user nova-compute[72780]: WARNING nova.compute.manager [req-cb548737-7c94-4ead-b4d5-4e4af873ad17 req-5736d7ec-9634-4dc5-98b0-537b7b0358d3 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received unexpected event network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 for instance with vm_state building and task_state spawning.
Aug 09 00:59:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG nova.objects.instance [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'flavor' on Instance uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 00:59:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6022266-6b48-4a69-ba32-faa2202432ce tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.982s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542786.4417682, 7ec77892-5c0c-4599-9533-3d8628c4c3f9 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] VM Resumed (Lifecycle Event)
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Instance spawned successfully.
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5752179-beaf-4796-b37a-f86a1ea1419b req-79aa68aa-3bad-4018-8b7c-f2f11905ce98 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5752179-beaf-4796-b37a-f86a1ea1419b req-79aa68aa-3bad-4018-8b7c-f2f11905ce98 service nova] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5752179-beaf-4796-b37a-f86a1ea1419b req-79aa68aa-3bad-4018-8b7c-f2f11905ce98 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5752179-beaf-4796-b37a-f86a1ea1419b req-79aa68aa-3bad-4018-8b7c-f2f11905ce98 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5752179-beaf-4796-b37a-f86a1ea1419b req-79aa68aa-3bad-4018-8b7c-f2f11905ce98 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] No waiting events found dispatching network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 00:59:46 user nova-compute[72780]: WARNING nova.compute.manager [req-c5752179-beaf-4796-b37a-f86a1ea1419b req-79aa68aa-3bad-4018-8b7c-f2f11905ce98 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received unexpected event network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 for instance with vm_state building and task_state spawning.
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542786.442767, 7ec77892-5c0c-4599-9533-3d8628c4c3f9 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] VM Started (Lifecycle Event)
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 09 00:59:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 00:59:46 user nova-compute[72780]: INFO nova.compute.manager [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Took 7.37 seconds to build instance.
Aug 09 00:59:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7be9d0e3-d88f-4a64-84c3-3741525df891 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 00:59:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 00:59:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "eef82018-54b7-471d-bee1-45bf26de56e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:00:00 user nova-compute[72780]: INFO nova.compute.claims [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Claim successful on node user
Aug 09 01:00:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:00:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:00:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.policy [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c93725c6c7e4001b478b1c87d6ba759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d09b1579894f47877a117276c7465f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:00:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Creating image(s)
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "/opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk 1073741824" returned: 0 in 0.052s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.network.neutron [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Successfully created port: 6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Cannot resize image /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'migration_context' on Instance uuid eef82018-54b7-471d-bee1-45bf26de56e1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Ensure instance console log exists: /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Successfully updated port: 6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-changed-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Refreshing instance network info cache due to event network-changed-6142885d-d0dd-419f-a811-b0a904b02740. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] Acquiring lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Updating instance_info_cache with network_info: [{"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Instance network_info: |[{"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] Acquired lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Refreshing network info cache for port 6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Start _get_guest_xml network_info=[{"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:00:02 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:02 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:00:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-866301270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-866301270',id=22,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-1emtxv3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:00:01Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=eef82018-54b7-471d-bee1-45bf26de56e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.objects.instance [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'pci_devices' on Instance uuid eef82018-54b7-471d-bee1-45bf26de56e1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:00:03 user nova-compute[72780]:   <uuid>eef82018-54b7-471d-bee1-45bf26de56e1</uuid>
Aug 09 01:00:03 user nova-compute[72780]:   <name>instance-00000016</name>
Aug 09 01:00:03 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:00:03 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:00:03 user nova-compute[72780]:   <metadata>
Aug 09 01:00:03 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:00:03 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:00:03 user nova-compute[72780]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-866301270</nova:name>
Aug 09 01:00:03 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:00:02</nova:creationTime>
Aug 09 01:00:03 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:00:03 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:00:03 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:00:03 user nova-compute[72780]:       <nova:owner>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:user uuid="4c93725c6c7e4001b478b1c87d6ba759">tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member</nova:user>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:project uuid="b3d09b1579894f47877a117276c7465f">tempest-ServerBootFromVolumeStableRescueTest-1823004913</nova:project>
Aug 09 01:00:03 user nova-compute[72780]:       </nova:owner>
Aug 09 01:00:03 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:00:03 user nova-compute[72780]:       <nova:ports>
Aug 09 01:00:03 user nova-compute[72780]:         <nova:port uuid="6142885d-d0dd-419f-a811-b0a904b02740">
Aug 09 01:00:03 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 01:00:03 user nova-compute[72780]:         </nova:port>
Aug 09 01:00:03 user nova-compute[72780]:       </nova:ports>
Aug 09 01:00:03 user nova-compute[72780]:     </nova:instance>
Aug 09 01:00:03 user nova-compute[72780]:   </metadata>
Aug 09 01:00:03 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:00:03 user nova-compute[72780]:     <system>
Aug 09 01:00:03 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:00:03 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:00:03 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:00:03 user nova-compute[72780]:       <entry name="serial">eef82018-54b7-471d-bee1-45bf26de56e1</entry>
Aug 09 01:00:03 user nova-compute[72780]:       <entry name="uuid">eef82018-54b7-471d-bee1-45bf26de56e1</entry>
Aug 09 01:00:03 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:00:03 user nova-compute[72780]:     </system>
Aug 09 01:00:03 user nova-compute[72780]:   </sysinfo>
Aug 09 01:00:03 user nova-compute[72780]:   <os>
Aug 09 01:00:03 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:00:03 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:00:03 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:00:03 user nova-compute[72780]:   </os>
Aug 09 01:00:03 user nova-compute[72780]:   <features>
Aug 09 01:00:03 user nova-compute[72780]:     <acpi/>
Aug 09 01:00:03 user nova-compute[72780]:     <apic/>
Aug 09 01:00:03 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:00:03 user nova-compute[72780]:   </features>
Aug 09 01:00:03 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:00:03 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:00:03 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:00:03 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:00:03 user nova-compute[72780]:   </clock>
Aug 09 01:00:03 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:00:03 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:00:03 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:00:03 user nova-compute[72780]:   </cpu>
Aug 09 01:00:03 user nova-compute[72780]:   <devices>
Aug 09 01:00:03 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:00:03 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:00:03 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk"/>
Aug 09 01:00:03 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:00:03 user nova-compute[72780]:     </disk>
Aug 09 01:00:03 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:00:03 user nova-compute[72780]:       <mac address="fa:16:3e:14:84:02"/>
Aug 09 01:00:03 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:00:03 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:00:03 user nova-compute[72780]:       <target dev="tap6142885d-d0"/>
Aug 09 01:00:03 user nova-compute[72780]:     </interface>
Aug 09 01:00:03 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:00:03 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/console.log" append="off"/>
Aug 09 01:00:03 user nova-compute[72780]:     </serial>
Aug 09 01:00:03 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:00:03 user nova-compute[72780]:     <video>
Aug 09 01:00:03 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:00:03 user nova-compute[72780]:     </video>
Aug 09 01:00:03 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:00:03 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:00:03 user nova-compute[72780]:     </rng>
Aug 09 01:00:03 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:00:03 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:00:03 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:00:03 user nova-compute[72780]:     </memballoon>
Aug 09 01:00:03 user nova-compute[72780]:   </devices>
Aug 09 01:00:03 user nova-compute[72780]: </domain>
Aug 09 01:00:03 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-866301270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-866301270',id=22,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-1emtxv3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:00:01Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=eef82018-54b7-471d-bee1-45bf26de56e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG os_vif [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6142885d-d0, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6142885d-d0, col_values=(('external_ids', {'iface-id': '6142885d-d0dd-419f-a811-b0a904b02740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:84:02', 'vm-uuid': 'eef82018-54b7-471d-bee1-45bf26de56e1'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:03 user nova-compute[72780]: INFO os_vif [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0')
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No VIF found with MAC fa:16:3e:14:84:02, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Updated VIF entry in instance network info cache for port 6142885d-d0dd-419f-a811-b0a904b02740. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Updating instance_info_cache with network_info: [{"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7c40f537-0528-4696-932c-76ab001ad7a6 req-d4d7d31c-a656-4ddd-ae1a-596c1cdc218d service nova] Releasing lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7b7372c-0d8d-4cbc-87e1-e0b9df1d6da1 req-dac689b5-2d13-4def-ace7-3c803681eff0 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7b7372c-0d8d-4cbc-87e1-e0b9df1d6da1 req-dac689b5-2d13-4def-ace7-3c803681eff0 service nova] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7b7372c-0d8d-4cbc-87e1-e0b9df1d6da1 req-dac689b5-2d13-4def-ace7-3c803681eff0 service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7b7372c-0d8d-4cbc-87e1-e0b9df1d6da1 req-dac689b5-2d13-4def-ace7-3c803681eff0 service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7b7372c-0d8d-4cbc-87e1-e0b9df1d6da1 req-dac689b5-2d13-4def-ace7-3c803681eff0 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] No waiting events found dispatching network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:04 user nova-compute[72780]: WARNING nova.compute.manager [req-c7b7372c-0d8d-4cbc-87e1-e0b9df1d6da1 req-dac689b5-2d13-4def-ace7-3c803681eff0 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received unexpected event network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 for instance with vm_state building and task_state spawning.
Aug 09 01:00:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542806.5742214, eef82018-54b7-471d-bee1-45bf26de56e1 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] VM Resumed (Lifecycle Event)
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Instance spawned successfully.
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542806.5753143, eef82018-54b7-471d-bee1-45bf26de56e1 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] VM Started (Lifecycle Event)
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [req-440c6a6a-d9bc-4978-9dd7-2997a1b6220f req-5e9c5d37-fd18-40ad-8e0a-b8abfeef3d5a service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-440c6a6a-d9bc-4978-9dd7-2997a1b6220f req-5e9c5d37-fd18-40ad-8e0a-b8abfeef3d5a service nova] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-440c6a6a-d9bc-4978-9dd7-2997a1b6220f req-5e9c5d37-fd18-40ad-8e0a-b8abfeef3d5a service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-440c6a6a-d9bc-4978-9dd7-2997a1b6220f req-5e9c5d37-fd18-40ad-8e0a-b8abfeef3d5a service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:06 user nova-compute[72780]: DEBUG nova.compute.manager [req-440c6a6a-d9bc-4978-9dd7-2997a1b6220f req-5e9c5d37-fd18-40ad-8e0a-b8abfeef3d5a service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] No waiting events found dispatching network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:06 user nova-compute[72780]: WARNING nova.compute.manager [req-440c6a6a-d9bc-4978-9dd7-2997a1b6220f req-5e9c5d37-fd18-40ad-8e0a-b8abfeef3d5a service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received unexpected event network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 for instance with vm_state active and task_state None.
Aug 09 01:00:06 user nova-compute[72780]: INFO nova.compute.manager [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Took 6.60 seconds to build instance.
Aug 09 01:00:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-058eab87-e096-46b5-874c-164690ddfaba tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "eef82018-54b7-471d-bee1-45bf26de56e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.702s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:12 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating instance_info_cache with network_info: [{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:00:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:00:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:00:20 user nova-compute[72780]: INFO nova.compute.claims [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Claim successful on node user
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.772s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:00:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:00:21 user nova-compute[72780]: INFO nova.virt.block_device [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Booting with volume ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 at /dev/vda
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.policy [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8412204a685048a6a787793a7266f085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb0278ced1640e9a1ab66e5cfcafc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG os_brick.utils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e34dc-2a19-4948-83d8-740d18de784d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f2c4f-576d-43e2-82ce-324fdfcbfc6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[421bd895-fe1c-4509-96bb-1343a280a5ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d43e5fb-8103-4587-8d15-1e06e7a93b94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:00:21 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22497f03-0b45-4b55-9769-f75f64dfc13a]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG os_brick.utils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating existing volume attachment record: 82507464-6a9f-4a01-8707-26525f80f572 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Successfully created port: 3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Successfully updated port: 3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquired lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-changed-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Refreshing instance network info cache due to event network-changed-3fc7961c-9c92-47fe-bc61-522c26fb2e70. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] Acquiring lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:00:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=6884MB free_disk=25.06106948852539GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Releasing lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance network_info: |[{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] Acquired lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Refreshing network info cache for port 3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Applying migration context for instance 9f271642-610f-451a-b6e1-159f2cf3523c as it has an incoming, in-progress migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc. Migration status is finished {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 01:00:24 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating resource usage from migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1928c3a6-c836-4487-bc21-5eb902fb61fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance deec36f5-a323-4595-b87a-abc995824040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a35ae1e9-1559-41c8-8476-d571b679c084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e9119959-190b-4b0a-98bc-21338c7ad20b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 83789356-a9ab-43ad-8701-376569301904 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 7ec77892-5c0c-4599-9533-3d8628c4c3f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updated VIF entry in instance network info cache for port 3fc7961c-9c92-47fe-bc61-522c26fb2e70. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7213425e-abb8-4360-9f5a-de517054b19a req-626c731b-a6ae-4d85-b4c4-ada6a5a52c42 service nova] Releasing lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:00:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:00:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Creating image(s)
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Ensure instance console log exists: /opt/stack/data/nova/instances/6515b699-7198-4fca-b3f5-30eeb70bf3b1/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Start _get_guest_xml network_info=[{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6515b699-7198-4fca-b3f5-30eeb70bf3b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac7fbb21-ba2f-469c-bfbd-60f69ac5af04', 'serial': 'ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'}, 'disk_bus': 'virtio', 'attachment_id': '82507464-6a9f-4a01-8707-26525f80f572', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:00:30 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:30 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:00:30 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:00:30 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:00:30 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17d16d9-c9f6-4035-bd0b-8f1a52881fa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:00:30 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f26f8-2d24-4d19-8b3b-28b18a4d3007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04] added
Aug 09 01:00:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[71000f96-c0d6-481d-8f56-df600fa8d501]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[169cd9b1-8ba2-499c-a223-09d47847f211]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwzxSQr {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwzxSQr" returned: 0 in 0.119s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b779e3-c029-4e3a-bae7-12582a7315ad]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hfwzxSQr'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa015a1b-2f5e-49e7-ab84-149fea163741]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c86d34-d182-470e-8e49-43da9cf48666]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:30 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:30 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:30 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:30 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:00:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3f48e7-c143-42a7-a6f8-212e6a93d4fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]
Aug 09 01:00:31 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.
Aug 09 01:00:31 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62f7631-05c4-46cf-9a7c-657b6556d7bb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7312459-672a-44c0-940f-97322228bbdc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:31 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:31 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:31 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:31 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:31 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:31 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:31 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:31 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.489s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1336116-95e3-4f3e-9edb-b73b74f72ea0]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:31 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '26632663463346432', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663463346432', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419978631',display_name='tempest-ServerActionsTestOtherA-server-419978631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419978631',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-y0t2dcnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=6515b699-7198-4fca-b3f5-30eeb70bf3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.objects.instance [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'pci_devices' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:00:32 user nova-compute[72780]:   <uuid>6515b699-7198-4fca-b3f5-30eeb70bf3b1</uuid>
Aug 09 01:00:32 user nova-compute[72780]:   <name>instance-00000017</name>
Aug 09 01:00:32 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:00:32 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:00:32 user nova-compute[72780]:   <metadata>
Aug 09 01:00:32 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:00:32 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:00:32 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherA-server-419978631</nova:name>
Aug 09 01:00:32 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:00:30</nova:creationTime>
Aug 09 01:00:32 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:00:32 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:00:32 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:00:32 user nova-compute[72780]:       <nova:owner>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:user uuid="8412204a685048a6a787793a7266f085">tempest-ServerActionsTestOtherA-1294078380-project-member</nova:user>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:project uuid="8eb0278ced1640e9a1ab66e5cfcafc8f">tempest-ServerActionsTestOtherA-1294078380</nova:project>
Aug 09 01:00:32 user nova-compute[72780]:       </nova:owner>
Aug 09 01:00:32 user nova-compute[72780]:       <nova:ports>
Aug 09 01:00:32 user nova-compute[72780]:         <nova:port uuid="3fc7961c-9c92-47fe-bc61-522c26fb2e70">
Aug 09 01:00:32 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 01:00:32 user nova-compute[72780]:         </nova:port>
Aug 09 01:00:32 user nova-compute[72780]:       </nova:ports>
Aug 09 01:00:32 user nova-compute[72780]:     </nova:instance>
Aug 09 01:00:32 user nova-compute[72780]:   </metadata>
Aug 09 01:00:32 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:00:32 user nova-compute[72780]:     <system>
Aug 09 01:00:32 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:00:32 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:00:32 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:00:32 user nova-compute[72780]:       <entry name="serial">6515b699-7198-4fca-b3f5-30eeb70bf3b1</entry>
Aug 09 01:00:32 user nova-compute[72780]:       <entry name="uuid">6515b699-7198-4fca-b3f5-30eeb70bf3b1</entry>
Aug 09 01:00:32 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:00:32 user nova-compute[72780]:     </system>
Aug 09 01:00:32 user nova-compute[72780]:   </sysinfo>
Aug 09 01:00:32 user nova-compute[72780]:   <os>
Aug 09 01:00:32 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:00:32 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:00:32 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:00:32 user nova-compute[72780]:   </os>
Aug 09 01:00:32 user nova-compute[72780]:   <features>
Aug 09 01:00:32 user nova-compute[72780]:     <acpi/>
Aug 09 01:00:32 user nova-compute[72780]:     <apic/>
Aug 09 01:00:32 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:00:32 user nova-compute[72780]:   </features>
Aug 09 01:00:32 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:00:32 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:00:32 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:00:32 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:00:32 user nova-compute[72780]:   </clock>
Aug 09 01:00:32 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:00:32 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:00:32 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:00:32 user nova-compute[72780]:   </cpu>
Aug 09 01:00:32 user nova-compute[72780]:   <devices>
Aug 09 01:00:32 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:00:32 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:00:32 user nova-compute[72780]:       <source dev="/dev/sdd"/>
Aug 09 01:00:32 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:00:32 user nova-compute[72780]:       <serial>ac7fbb21-ba2f-469c-bfbd-60f69ac5af04</serial>
Aug 09 01:00:32 user nova-compute[72780]:     </disk>
Aug 09 01:00:32 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:00:32 user nova-compute[72780]:       <mac address="fa:16:3e:9e:70:a5"/>
Aug 09 01:00:32 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:00:32 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:00:32 user nova-compute[72780]:       <target dev="tap3fc7961c-9c"/>
Aug 09 01:00:32 user nova-compute[72780]:     </interface>
Aug 09 01:00:32 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:00:32 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/6515b699-7198-4fca-b3f5-30eeb70bf3b1/console.log" append="off"/>
Aug 09 01:00:32 user nova-compute[72780]:     </serial>
Aug 09 01:00:32 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:00:32 user nova-compute[72780]:     <video>
Aug 09 01:00:32 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:00:32 user nova-compute[72780]:     </video>
Aug 09 01:00:32 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:00:32 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:00:32 user nova-compute[72780]:     </rng>
Aug 09 01:00:32 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:00:32 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:00:32 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:00:32 user nova-compute[72780]:     </memballoon>
Aug 09 01:00:32 user nova-compute[72780]:   </devices>
Aug 09 01:00:32 user nova-compute[72780]: </domain>
Aug 09 01:00:32 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419978631',display_name='tempest-ServerActionsTestOtherA-server-419978631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419978631',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-y0t2dcnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=6515b699-7198-4fca-b3f5-30eeb70bf3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG os_vif [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fc7961c-9c, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fc7961c-9c, col_values=(('external_ids', {'iface-id': '3fc7961c-9c92-47fe-bc61-522c26fb2e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:70:a5', 'vm-uuid': '6515b699-7198-4fca-b3f5-30eeb70bf3b1'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:32 user nova-compute[72780]: INFO os_vif [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c')
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:00:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No VIF found with MAC fa:16:3e:9e:70:a5, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-changed-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Refreshing instance network info cache due to event network-changed-a45ab989-5763-466b-b942-8c998e5c36e1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] Acquiring lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] Acquired lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Refreshing network info cache for port a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:33 user nova-compute[72780]: INFO nova.compute.manager [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Terminating instance
Aug 09 01:00:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Instance destroyed successfully.
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.objects.instance [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'resources' on Instance uuid 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.network.neutron [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updated VIF entry in instance network info cache for port a45ab989-5763-466b-b942-8c998e5c36e1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.network.neutron [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating instance_info_cache with network_info: [{"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-619277494',display_name='tempest-TestStampPattern-server-619277494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-619277494',id=18,image_ref='1de5f074-9a67-4d03-b2ee-c7812d43949b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI07VMD4TclndvCxE6L38Kfcl2+xDDK4chst8IOjrrMvWh8Il4bIaWiI0srekfxk1YveAsel1TDoaTLMrNZK/VdAns7XVogJbCxdGHNJMvvjMwF4xr/mRlMFXTrSY23piA==',key_name='tempest-TestStampPattern-2067735695',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa1d9106ffe1447fa6b5ee6fbfc58417',ramdisk_id='',reservation_id='r-wswv592d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='abc4a45e-2b7e-4038-9e67-a16a419e43bb',image_min_disk='1',image_min_ram='0',image_owner_id='fa1d9106ffe1447fa6b5ee6fbfc58417',image_owner_project_name='tempest-TestStampPattern-753935542',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-753935542-project-member',image_user_id='bade11d5ae3a4aa4bca3a34aa14298ce',owner_project_name='tempest-TestStampPattern-753935542',owner_user_name='tempest-TestStampPattern-753935542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:57:44Z,user_data=None,user_id='bade11d5ae3a4aa4bca3a34aa14298ce',uuid=8f1b3dad-b364-43df-acda-8ebb26dbb5c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converting VIF {"id": "a45ab989-5763-466b-b942-8c998e5c36e1", "address": "fa:16:3e:4e:e4:0e", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa45ab989-57", "ovs_interfaceid": "a45ab989-5763-466b-b942-8c998e5c36e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG os_vif [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5db309d3-73dd-4d5f-885d-61e7db134ccc req-5a94f0e4-369b-4d2b-9c15-e9763121ec08 service nova] Releasing lock "refresh_cache-8f1b3dad-b364-43df-acda-8ebb26dbb5c1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa45ab989-57, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:34 user nova-compute[72780]: INFO os_vif [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e4:0e,bridge_name='br-int',has_traffic_filtering=True,id=a45ab989-5763-466b-b942-8c998e5c36e1,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa45ab989-57')
Aug 09 01:00:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Deleting instance files /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1_del
Aug 09 01:00:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Deletion of /opt/stack/data/nova/instances/8f1b3dad-b364-43df-acda-8ebb26dbb5c1_del complete
Aug 09 01:00:34 user nova-compute[72780]: INFO nova.compute.manager [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 01:00:34 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:00:34 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-41ca0a43-797b-417b-9dfe-5fb6f575ab86 req-7bfc342f-59d6-4a08-b6ee-d4891050ffb1 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-vif-deleted-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:35 user nova-compute[72780]: INFO nova.compute.manager [req-41ca0a43-797b-417b-9dfe-5fb6f575ab86 req-7bfc342f-59d6-4a08-b6ee-d4891050ffb1 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Neutron deleted interface a45ab989-5763-466b-b942-8c998e5c36e1; detaching it from the instance and deleting it from the info cache
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.network.neutron [req-41ca0a43-797b-417b-9dfe-5fb6f575ab86 req-7bfc342f-59d6-4a08-b6ee-d4891050ffb1 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:35 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Took 0.97 seconds to deallocate network for instance.
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-41ca0a43-797b-417b-9dfe-5fb6f575ab86 req-7bfc342f-59d6-4a08-b6ee-d4891050ffb1 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Detach interface failed, port_id=a45ab989-5763-466b-b942-8c998e5c36e1, reason: Instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-vif-unplugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] No waiting events found dispatching network-vif-unplugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-vif-unplugged-a45ab989-5763-466b-b942-8c998e5c36e1 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received event network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Acquiring lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] No waiting events found dispatching network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:35 user nova-compute[72780]: WARNING nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Received unexpected event network-vif-plugged-a45ab989-5763-466b-b942-8c998e5c36e1 for instance with vm_state active and task_state deleting.
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:35 user nova-compute[72780]: WARNING nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state building and task_state spawning.
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:35 user nova-compute[72780]: WARNING nova.compute.manager [req-a2ceaccf-29fd-4e69-af1a-cc4e5ecdb8df req-c64ada05-af19-41d3-bf79-f8b4b587bad5 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state building and task_state spawning.
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Deleted allocations for instance 8f1b3dad-b364-43df-acda-8ebb26dbb5c1
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542836.340942, 6515b699-7198-4fca-b3f5-30eeb70bf3b1 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] VM Resumed (Lifecycle Event)
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance spawned successfully.
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542836.3419394, 6515b699-7198-4fca-b3f5-30eeb70bf3b1 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] VM Started (Lifecycle Event)
Aug 09 01:00:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bea7a589-cffb-404d-b96f-6a71ec6c53c8 tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "8f1b3dad-b364-43df-acda-8ebb26dbb5c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.662s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Port 43628f21-b02e-42b7-9469-004c6be8b75a binding to destination host user is already ACTIVE {{(pid=72780) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 09 01:00:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:36 user nova-compute[72780]: INFO nova.compute.manager [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Took 16.40 seconds to build instance.
Aug 09 01:00:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1bcb27b7-c742-4be6-9b77-f95927f70739 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.569s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Creating tmpfile /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/tmpzibad7ux to verify with other compute node that the instance is on the same shared storage. {{(pid=72780) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-888f2f7a-1520-410a-98c0-9118d4907469 req-ce763454-2d6a-4e37-b04d-8319e79a63be service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-888f2f7a-1520-410a-98c0-9118d4907469 req-ce763454-2d6a-4e37-b04d-8319e79a63be service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-888f2f7a-1520-410a-98c0-9118d4907469 req-ce763454-2d6a-4e37-b04d-8319e79a63be service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-888f2f7a-1520-410a-98c0-9118d4907469 req-ce763454-2d6a-4e37-b04d-8319e79a63be service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-888f2f7a-1520-410a-98c0-9118d4907469 req-ce763454-2d6a-4e37-b04d-8319e79a63be service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:37 user nova-compute[72780]: WARNING nova.compute.manager [req-888f2f7a-1520-410a-98c0-9118d4907469 req-ce763454-2d6a-4e37-b04d-8319e79a63be service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance destroyed successfully.
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'resources' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43628f21-b0, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: INFO os_vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0')
Aug 09 01:00:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:00:38 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1024fb-f133-42b4-8efd-4635dd2a2d8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33560a3-f969-45b9-ba0a-87c431589a50]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:38 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:38 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:38 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:38 user nova-compute[72780]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:38 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:38 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ae64ca950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[32655db9-096f-4d89-8ab1-bedb5a4a26ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c5d52-8255-4756-aa67-e967bb061b73]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a55936b-e661-496b-aa90-c44623ff945d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36355e48-b855-4434-a856-946a5c3709d5]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43bd05-64b1-4a90-b8e2-2ea918a1834e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[254544dc-9c57-4a21-ac74-541f5c9b25e8]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]
Aug 09 01:00:38 user nova-compute[72780]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.
Aug 09 01:00:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1157c039-0183-4c7f-af8a-194ca1fac42a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== disconnect_volume: return (391ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:00:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'migration_context' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:39 user nova-compute[72780]: WARNING nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:39 user nova-compute[72780]: WARNING nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:39 user nova-compute[72780]: WARNING nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:39 user nova-compute[72780]: WARNING nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:39 user nova-compute[72780]: WARNING nova.compute.manager [req-5d393227-edcf-4fa8-ad43-3bc95c498348 req-75902e5c-278c-44d9-af58-b5d335f17887 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:40 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:00:40 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:00:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.559s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:40 user nova-compute[72780]: INFO nova.compute.manager [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Swapping old allocation on dict_keys(['b9abbddb-d385-4222-ae5f-4e6421336ccf']) held by migration 6a202b68-89af-4a99-9ee2-f35e1ec9eedc for instance
Aug 09 01:00:40 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Overwriting current allocation {'allocations': {'b9abbddb-d385-4222-ae5f-4e6421336ccf': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': 'f4b5ecdb327a4ee98887cd048c08ca0d', 'user_id': '70e71720a3524b229f3c2c7a327db2c8', 'consumer_generation': 1} on consumer 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 01:00:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:00:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:00:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG os_brick.utils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f1150-33b2-4feb-a337-9d1ab3cf42a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c4bb44-731b-4a2f-b7c2-f10bfe28f6e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8d6629-ba6f-4ef2-921a-814a8bcd280d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0a73f6-521c-49fb-9c2a-ba81bbc02127]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:00:41 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:00:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c0f9f-5626-4416-8622-4aa82a2e3b82]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:00:41 user nova-compute[72780]: DEBUG os_brick.utils [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:00:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:00:49 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542834.5652983, 8f1b3dad-b364-43df-acda-8ebb26dbb5c1 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:49 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] VM Stopped (Lifecycle Event)
Aug 09 01:00:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6bb7f3a3-2f71-4d90-8c4f-740ec2b9b6a8 None None] [instance: 8f1b3dad-b364-43df-acda-8ebb26dbb5c1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Starting finish_revert_migration {{(pid=72780) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start _get_guest_xml network_info=[{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9f271642-610f-451a-b6e1-159f2cf3523c', 'attached_at': '2023-08-09T01:00:51.000000', 'detached_at': '', 'volume_id': 'cc9917b1-e23b-43f1-ae97-02dba67e4095', 'serial': 'cc9917b1-e23b-43f1-ae97-02dba67e4095'}, 'disk_bus': 'virtio', 'attachment_id': '1879a4d3-263e-4103-b7e7-752b0e13a9f7', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:00:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:00:51 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:00:51 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:00:51 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb296c-3bdc-4482-b7de-0280df705748]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:00:51 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc69877-bd27-4da0-b0f9-0db33b827866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095] added
Aug 09 01:00:51 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec12ff9-980d-4bb2-baeb-e0db0a939788]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36dd0e-9c82-43ae-b2bf-c20ba7805154]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clmeZgnX {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v clmeZgnX" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[851b5943-e919-444d-8bf1-b624e571a102]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'clmeZgnX'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df7f56a-1308-45d1-b4c9-7d17c0070e88]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a14ff3c-e4df-45d2-b69a-42e64f5a4617]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --login" returned: 0 in 0.136s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b4c00-c0d9-44e4-9338-130672a2b5b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]
Aug 09 01:00:51 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.
Aug 09 01:00:51 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa507f-560b-4a8c-a844-e1260582e0e0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92c3bd4-8519-43a5-9b83-37f9451db4c3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:00:51 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e864ae-6077-4c88-a205-5743e060bc23]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:00:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23062313039316464', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062313039316464', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:00:52 user nova-compute[72780]:   <uuid>9f271642-610f-451a-b6e1-159f2cf3523c</uuid>
Aug 09 01:00:52 user nova-compute[72780]:   <name>instance-0000000d</name>
Aug 09 01:00:52 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:00:52 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:00:52 user nova-compute[72780]:   <metadata>
Aug 09 01:00:52 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:00:52 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:00:52 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherB-server-1122386235</nova:name>
Aug 09 01:00:52 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:00:51</nova:creationTime>
Aug 09 01:00:52 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:00:52 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:00:52 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:00:52 user nova-compute[72780]:       <nova:owner>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:user uuid="70e71720a3524b229f3c2c7a327db2c8">tempest-ServerActionsTestOtherB-897270837-project-member</nova:user>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:project uuid="f4b5ecdb327a4ee98887cd048c08ca0d">tempest-ServerActionsTestOtherB-897270837</nova:project>
Aug 09 01:00:52 user nova-compute[72780]:       </nova:owner>
Aug 09 01:00:52 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:00:52 user nova-compute[72780]:       <nova:ports>
Aug 09 01:00:52 user nova-compute[72780]:         <nova:port uuid="43628f21-b02e-42b7-9469-004c6be8b75a">
Aug 09 01:00:52 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 01:00:52 user nova-compute[72780]:         </nova:port>
Aug 09 01:00:52 user nova-compute[72780]:       </nova:ports>
Aug 09 01:00:52 user nova-compute[72780]:     </nova:instance>
Aug 09 01:00:52 user nova-compute[72780]:   </metadata>
Aug 09 01:00:52 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:00:52 user nova-compute[72780]:     <system>
Aug 09 01:00:52 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:00:52 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:00:52 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:00:52 user nova-compute[72780]:       <entry name="serial">9f271642-610f-451a-b6e1-159f2cf3523c</entry>
Aug 09 01:00:52 user nova-compute[72780]:       <entry name="uuid">9f271642-610f-451a-b6e1-159f2cf3523c</entry>
Aug 09 01:00:52 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:00:52 user nova-compute[72780]:     </system>
Aug 09 01:00:52 user nova-compute[72780]:   </sysinfo>
Aug 09 01:00:52 user nova-compute[72780]:   <os>
Aug 09 01:00:52 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:00:52 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:00:52 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:00:52 user nova-compute[72780]:   </os>
Aug 09 01:00:52 user nova-compute[72780]:   <features>
Aug 09 01:00:52 user nova-compute[72780]:     <acpi/>
Aug 09 01:00:52 user nova-compute[72780]:     <apic/>
Aug 09 01:00:52 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:00:52 user nova-compute[72780]:   </features>
Aug 09 01:00:52 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:00:52 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:00:52 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:00:52 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:00:52 user nova-compute[72780]:   </clock>
Aug 09 01:00:52 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:00:52 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:00:52 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:00:52 user nova-compute[72780]:   </cpu>
Aug 09 01:00:52 user nova-compute[72780]:   <devices>
Aug 09 01:00:52 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:00:52 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:00:52 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk"/>
Aug 09 01:00:52 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:00:52 user nova-compute[72780]:     </disk>
Aug 09 01:00:52 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:00:52 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:00:52 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 01:00:52 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:00:52 user nova-compute[72780]:       <serial>cc9917b1-e23b-43f1-ae97-02dba67e4095</serial>
Aug 09 01:00:52 user nova-compute[72780]:     </disk>
Aug 09 01:00:52 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:00:52 user nova-compute[72780]:       <mac address="fa:16:3e:3a:22:77"/>
Aug 09 01:00:52 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:00:52 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:00:52 user nova-compute[72780]:       <target dev="tap43628f21-b0"/>
Aug 09 01:00:52 user nova-compute[72780]:     </interface>
Aug 09 01:00:52 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:00:52 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/console.log" append="off"/>
Aug 09 01:00:52 user nova-compute[72780]:     </serial>
Aug 09 01:00:52 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:00:52 user nova-compute[72780]:     <video>
Aug 09 01:00:52 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:00:52 user nova-compute[72780]:     </video>
Aug 09 01:00:52 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:00:52 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:00:52 user nova-compute[72780]:     </rng>
Aug 09 01:00:52 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:00:52 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:00:52 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:00:52 user nova-compute[72780]:     </memballoon>
Aug 09 01:00:52 user nova-compute[72780]:   </devices>
Aug 09 01:00:52 user nova-compute[72780]: </domain>
Aug 09 01:00:52 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG os_vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43628f21-b0, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43628f21-b0, col_values=(('external_ids', {'iface-id': '43628f21-b02e-42b7-9469-004c6be8b75a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:22:77', 'vm-uuid': '9f271642-610f-451a-b6e1-159f2cf3523c'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:00:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:52 user nova-compute[72780]: INFO os_vif [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0')
Aug 09 01:00:53 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542838.2257676, 9f271642-610f-451a-b6e1-159f2cf3523c => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:53 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Stopped (Lifecycle Event)
Aug 09 01:00:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1c2dc5e8-0762-4589-931e-0dfab8f78949 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-8637b679-4855-4f2e-873d-df59c7b2688a req-eaa3e324-e0a5-4432-bebf-5e239fe949ff service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8637b679-4855-4f2e-873d-df59c7b2688a req-eaa3e324-e0a5-4432-bebf-5e239fe949ff service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8637b679-4855-4f2e-873d-df59c7b2688a req-eaa3e324-e0a5-4432-bebf-5e239fe949ff service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8637b679-4855-4f2e-873d-df59c7b2688a req-eaa3e324-e0a5-4432-bebf-5e239fe949ff service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-8637b679-4855-4f2e-873d-df59c7b2688a req-eaa3e324-e0a5-4432-bebf-5e239fe949ff service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:54 user nova-compute[72780]: WARNING nova.compute.manager [req-8637b679-4855-4f2e-873d-df59c7b2688a req-eaa3e324-e0a5-4432-bebf-5e239fe949ff service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state resized and task_state resize_reverting.
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542856.245594, 9f271642-610f-451a-b6e1-159f2cf3523c => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Resumed (Lifecycle Event)
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:00:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance running successfully.
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] finish_revert_migration finished successfully. {{(pid=72780) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:00:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542856.247067, 9f271642-610f-451a-b6e1-159f2cf3523c => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:00:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Started (Lifecycle Event)
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:00:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 01:00:56 user nova-compute[72780]: INFO nova.compute.manager [None req-c141c775-ad40-4318-b75b-77cf45b544ff tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance to original state: 'active'
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-bddc3939-41b7-49d4-95a5-d5bc0c0ffe93 req-3d94e6d9-c4ce-4fba-959f-4d0153927dec service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bddc3939-41b7-49d4-95a5-d5bc0c0ffe93 req-3d94e6d9-c4ce-4fba-959f-4d0153927dec service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bddc3939-41b7-49d4-95a5-d5bc0c0ffe93 req-3d94e6d9-c4ce-4fba-959f-4d0153927dec service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bddc3939-41b7-49d4-95a5-d5bc0c0ffe93 req-3d94e6d9-c4ce-4fba-959f-4d0153927dec service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:00:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-bddc3939-41b7-49d4-95a5-d5bc0c0ffe93 req-3d94e6d9-c4ce-4fba-959f-4d0153927dec service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:00:56 user nova-compute[72780]: WARNING nova.compute.manager [req-bddc3939-41b7-49d4-95a5-d5bc0c0ffe93 req-3d94e6d9-c4ce-4fba-959f-4d0153927dec service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state None.
Aug 09 01:00:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:09 user nova-compute[72780]: INFO nova.compute.manager [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Terminating instance
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-61fb1bbc-a37d-451f-bd6c-c7cf99c1ae87 req-e6a98149-f024-492f-8eae-a8152d470cad service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-vif-unplugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61fb1bbc-a37d-451f-bd6c-c7cf99c1ae87 req-e6a98149-f024-492f-8eae-a8152d470cad service nova] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61fb1bbc-a37d-451f-bd6c-c7cf99c1ae87 req-e6a98149-f024-492f-8eae-a8152d470cad service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61fb1bbc-a37d-451f-bd6c-c7cf99c1ae87 req-e6a98149-f024-492f-8eae-a8152d470cad service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-61fb1bbc-a37d-451f-bd6c-c7cf99c1ae87 req-e6a98149-f024-492f-8eae-a8152d470cad service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] No waiting events found dispatching network-vif-unplugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-61fb1bbc-a37d-451f-bd6c-c7cf99c1ae87 req-e6a98149-f024-492f-8eae-a8152d470cad service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-vif-unplugged-15e0e778-ad70-4dea-a426-d4dca9cef78b for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:01:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Instance destroyed successfully.
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lazy-loading 'resources' on Instance uuid e9119959-190b-4b0a-98bc-21338c7ad20b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1028900195',display_name='tempest-VolumesActionsTest-instance-1028900195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1028900195',id=19,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:59:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2f203320294ed59055d5d0d3cf322a',ramdisk_id='',reservation_id='r-j7g8gtkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1675369655',owner_user_name='tempest-VolumesActionsTest-1675369655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:59:26Z,user_data=None,user_id='da43fc200f6044668eec95f723ec2486',uuid=e9119959-190b-4b0a-98bc-21338c7ad20b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converting VIF {"id": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "address": "fa:16:3e:4d:66:96", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e0e778-ad", "ovs_interfaceid": "15e0e778-ad70-4dea-a426-d4dca9cef78b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG os_vif [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e0e778-ad, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:09 user nova-compute[72780]: INFO os_vif [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:66:96,bridge_name='br-int',has_traffic_filtering=True,id=15e0e778-ad70-4dea-a426-d4dca9cef78b,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e0e778-ad')
Aug 09 01:01:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Deleting instance files /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b_del
Aug 09 01:01:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Deletion of /opt/stack/data/nova/instances/e9119959-190b-4b0a-98bc-21338c7ad20b_del complete
Aug 09 01:01:09 user nova-compute[72780]: INFO nova.compute.manager [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 09 01:01:09 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:01:09 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:10 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Took 0.53 seconds to deallocate network for instance.
Aug 09 01:01:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-000dcd5b-bfc5-48a3-b030-372bf0120950 req-b6ea0acc-a03a-456c-a87c-6a1c76c1d888 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-vif-deleted-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:10 user nova-compute[72780]: INFO nova.compute.manager [req-000dcd5b-bfc5-48a3-b030-372bf0120950 req-b6ea0acc-a03a-456c-a87c-6a1c76c1d888 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Neutron deleted interface 15e0e778-ad70-4dea-a426-d4dca9cef78b; detaching it from the instance and deleting it from the info cache
Aug 09 01:01:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-000dcd5b-bfc5-48a3-b030-372bf0120950 req-b6ea0acc-a03a-456c-a87c-6a1c76c1d888 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-000dcd5b-bfc5-48a3-b030-372bf0120950 req-b6ea0acc-a03a-456c-a87c-6a1c76c1d888 service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Detach interface failed, port_id=15e0e778-ad70-4dea-a426-d4dca9cef78b, reason: Instance e9119959-190b-4b0a-98bc-21338c7ad20b could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:11 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Deleted allocations for instance e9119959-190b-4b0a-98bc-21338c7ad20b
Aug 09 01:01:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-48bdff69-9c0e-4400-8ef0-0144a25c6b0e tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-11c8562a-a262-4266-8a76-16a0cab7fa37 req-e1cbf53c-fc4f-4f1e-947a-92ef8633cf0b service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received event network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-11c8562a-a262-4266-8a76-16a0cab7fa37 req-e1cbf53c-fc4f-4f1e-947a-92ef8633cf0b service nova] Acquiring lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-11c8562a-a262-4266-8a76-16a0cab7fa37 req-e1cbf53c-fc4f-4f1e-947a-92ef8633cf0b service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-11c8562a-a262-4266-8a76-16a0cab7fa37 req-e1cbf53c-fc4f-4f1e-947a-92ef8633cf0b service nova] Lock "e9119959-190b-4b0a-98bc-21338c7ad20b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-11c8562a-a262-4266-8a76-16a0cab7fa37 req-e1cbf53c-fc4f-4f1e-947a-92ef8633cf0b service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] No waiting events found dispatching network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:11 user nova-compute[72780]: WARNING nova.compute.manager [req-11c8562a-a262-4266-8a76-16a0cab7fa37 req-e1cbf53c-fc4f-4f1e-947a-92ef8633cf0b service nova] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Received unexpected event network-vif-plugged-15e0e778-ad70-4dea-a426-d4dca9cef78b for instance with vm_state deleted and task_state None.
Aug 09 01:01:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:13 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:01:16 user nova-compute[72780]: INFO nova.compute.manager [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Terminating instance
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-a09c4475-9787-42d0-bfdd-e385e72bd22b req-8a6a4ede-3403-45ca-9b12-75c325c441da service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a09c4475-9787-42d0-bfdd-e385e72bd22b req-8a6a4ede-3403-45ca-9b12-75c325c441da service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a09c4475-9787-42d0-bfdd-e385e72bd22b req-8a6a4ede-3403-45ca-9b12-75c325c441da service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a09c4475-9787-42d0-bfdd-e385e72bd22b req-8a6a4ede-3403-45ca-9b12-75c325c441da service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-a09c4475-9787-42d0-bfdd-e385e72bd22b req-8a6a4ede-3403-45ca-9b12-75c325c441da service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-a09c4475-9787-42d0-bfdd-e385e72bd22b req-8a6a4ede-3403-45ca-9b12-75c325c441da service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-unplugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Instance destroyed successfully.
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'resources' on Instance uuid 1928c3a6-c836-4487-bc21-5eb902fb61fa {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1294527405',display_name='tempest-AttachVolumeTestJSON-server-1294527405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1294527405',id=4,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzJb2mMUNZMRDpoRcBAgIdDO0FhPc89jcHeHQwovNXriznCaRgaBT+IJWEweTJrQVcI0VtAqJXuMZsbvo7wl2JeDxQTCTqNARoWrEgsjzUS95B4C+mcDbckezbJasd3CQ==',key_name='tempest-keypair-1968867488',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-o0r2ymnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=1928c3a6-c836-4487-bc21-5eb902fb61fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "address": "fa:16:3e:cb:2c:84", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2b5d5d-b7", "ovs_interfaceid": "fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG os_vif [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc2b5d5d-b7, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:01:16 user nova-compute[72780]: INFO os_vif [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2c:84,bridge_name='br-int',has_traffic_filtering=True,id=fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2b5d5d-b7')
Aug 09 01:01:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Deleting instance files /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa_del
Aug 09 01:01:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Deletion of /opt/stack/data/nova/instances/1928c3a6-c836-4487-bc21-5eb902fb61fa_del complete
Aug 09 01:01:16 user nova-compute[72780]: INFO nova.compute.manager [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 09 01:01:16 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:01:16 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:18 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Took 1.26 seconds to deallocate network for instance.
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-e6bbdcba-e3c3-4bee-9d38-0efe60e8580e req-75b89399-f345-4152-84da-2f54b59d9e34 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-deleted-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:18 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Deleted allocations for instance 1928c3a6-c836-4487-bc21-5eb902fb61fa
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-5a504099-a987-4b71-bc86-0972ffca6330 req-f2ff666d-fc7e-4236-beb4-bb8abde9bf60 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5a504099-a987-4b71-bc86-0972ffca6330 req-f2ff666d-fc7e-4236-beb4-bb8abde9bf60 service nova] Acquiring lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5a504099-a987-4b71-bc86-0972ffca6330 req-f2ff666d-fc7e-4236-beb4-bb8abde9bf60 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5a504099-a987-4b71-bc86-0972ffca6330 req-f2ff666d-fc7e-4236-beb4-bb8abde9bf60 service nova] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-5a504099-a987-4b71-bc86-0972ffca6330 req-f2ff666d-fc7e-4236-beb4-bb8abde9bf60 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] No waiting events found dispatching network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:18 user nova-compute[72780]: WARNING nova.compute.manager [req-5a504099-a987-4b71-bc86-0972ffca6330 req-f2ff666d-fc7e-4236-beb4-bb8abde9bf60 service nova] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Received unexpected event network-vif-plugged-fc2b5d5d-b7a0-4a9b-b1f0-70f16b3ceda2 for instance with vm_state deleted and task_state None.
Aug 09 01:01:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-30ebb791-171c-4f37-9681-c49d6f3b3565 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "1928c3a6-c836-4487-bc21-5eb902fb61fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.736s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:01:21 user nova-compute[72780]: INFO nova.compute.claims [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Claim successful on node user
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:01:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG nova.policy [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76b8b1600f374a0f93aa515a17e5fa32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ed02fd4f2445d292ae2d2ebf8d7bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:01:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Creating image(s)
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "/opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "/opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.160s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk 1073741824" returned: 0 in 0.077s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Successfully created port: 9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Cannot resize image /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lazy-loading 'migration_context' on Instance uuid bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Ensure instance console log exists: /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:01:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Successfully updated port: 9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-changed-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Refreshing instance network info cache due to event network-changed-9441fd0c-536a-494e-83dd-6cba552ca2cb. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] Acquiring lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] Acquired lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Refreshing network info cache for port 9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:01:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:01:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7129MB free_disk=25.104812622070312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542869.8423257, e9119959-190b-4b0a-98bc-21338c7ad20b => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:24 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] VM Stopped (Lifecycle Event)
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance abc4a45e-2b7e-4038-9e67-a16a419e43bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance deec36f5-a323-4595-b87a-abc995824040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a35ae1e9-1559-41c8-8476-d571b679c084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 83789356-a9ab-43ad-8701-376569301904 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 7ec77892-5c0c-4599-9533-3d8628c4c3f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance bbe38c09-7b3d-481a-b414-d70a0f89332b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-02d04272-d817-4e2d-8ffb-56d10811b461 None None] [instance: e9119959-190b-4b0a-98bc-21338c7ad20b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d50c5b7a-c23e-4c37-95d2-9ea33f7d6cc0 req-a6d8ca75-eb56-4440-a6ac-6eae8d398ec1 service nova] Releasing lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquired lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:01:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Updating instance_info_cache with network_info: [{"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Releasing lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Instance network_info: |[{"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Start _get_guest_xml network_info=[{"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:01:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:01:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7921795',id=24,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6SzWkdkeChpEDwfG/gb/UwilPvPkIV3DPHGWUF9DdJERtqoMO8p5+sH/BzanLtdhHHMi8gs3IpF4eCDmFK7uCHwUYt2MUHfUfTLneCbmUlgvWmLfHh4USNtcN8IrA31Q==',key_name='tempest-keypair-223497019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89ed02fd4f2445d292ae2d2ebf8d7bde',ramdisk_id='',reservation_id='r-p2znusi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1760079964',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b8b1600f374a0f93aa515a17e5fa32',uuid=bbe38c09-7b3d-481a-b414-d70a0f89332b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Converting VIF {"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lazy-loading 'pci_devices' on Instance uuid bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:01:25 user nova-compute[72780]:   <uuid>bbe38c09-7b3d-481a-b414-d70a0f89332b</uuid>
Aug 09 01:01:25 user nova-compute[72780]:   <name>instance-00000018</name>
Aug 09 01:01:25 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:01:25 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:01:25 user nova-compute[72780]:   <metadata>
Aug 09 01:01:25 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:01:25 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:01:25 user nova-compute[72780]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523</nova:name>
Aug 09 01:01:25 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:01:25</nova:creationTime>
Aug 09 01:01:25 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:01:25 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:01:25 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:01:25 user nova-compute[72780]:       <nova:owner>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:user uuid="76b8b1600f374a0f93aa515a17e5fa32">tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member</nova:user>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:project uuid="89ed02fd4f2445d292ae2d2ebf8d7bde">tempest-TestServerVolumeAttachScenarioOldVersion-1760079964</nova:project>
Aug 09 01:01:25 user nova-compute[72780]:       </nova:owner>
Aug 09 01:01:25 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:01:25 user nova-compute[72780]:       <nova:ports>
Aug 09 01:01:25 user nova-compute[72780]:         <nova:port uuid="9441fd0c-536a-494e-83dd-6cba552ca2cb">
Aug 09 01:01:25 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 01:01:25 user nova-compute[72780]:         </nova:port>
Aug 09 01:01:25 user nova-compute[72780]:       </nova:ports>
Aug 09 01:01:25 user nova-compute[72780]:     </nova:instance>
Aug 09 01:01:25 user nova-compute[72780]:   </metadata>
Aug 09 01:01:25 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:01:25 user nova-compute[72780]:     <system>
Aug 09 01:01:25 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:01:25 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:01:25 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:01:25 user nova-compute[72780]:       <entry name="serial">bbe38c09-7b3d-481a-b414-d70a0f89332b</entry>
Aug 09 01:01:25 user nova-compute[72780]:       <entry name="uuid">bbe38c09-7b3d-481a-b414-d70a0f89332b</entry>
Aug 09 01:01:25 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:01:25 user nova-compute[72780]:     </system>
Aug 09 01:01:25 user nova-compute[72780]:   </sysinfo>
Aug 09 01:01:25 user nova-compute[72780]:   <os>
Aug 09 01:01:25 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:01:25 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:01:25 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:01:25 user nova-compute[72780]:   </os>
Aug 09 01:01:25 user nova-compute[72780]:   <features>
Aug 09 01:01:25 user nova-compute[72780]:     <acpi/>
Aug 09 01:01:25 user nova-compute[72780]:     <apic/>
Aug 09 01:01:25 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:01:25 user nova-compute[72780]:   </features>
Aug 09 01:01:25 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:01:25 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:01:25 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:01:25 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:01:25 user nova-compute[72780]:   </clock>
Aug 09 01:01:25 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:01:25 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:01:25 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:01:25 user nova-compute[72780]:   </cpu>
Aug 09 01:01:25 user nova-compute[72780]:   <devices>
Aug 09 01:01:25 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:01:25 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:01:25 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk"/>
Aug 09 01:01:25 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:01:25 user nova-compute[72780]:     </disk>
Aug 09 01:01:25 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:01:25 user nova-compute[72780]:       <mac address="fa:16:3e:93:2e:fe"/>
Aug 09 01:01:25 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:01:25 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:01:25 user nova-compute[72780]:       <target dev="tap9441fd0c-53"/>
Aug 09 01:01:25 user nova-compute[72780]:     </interface>
Aug 09 01:01:25 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:01:25 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/console.log" append="off"/>
Aug 09 01:01:25 user nova-compute[72780]:     </serial>
Aug 09 01:01:25 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:01:25 user nova-compute[72780]:     <video>
Aug 09 01:01:25 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:01:25 user nova-compute[72780]:     </video>
Aug 09 01:01:25 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:01:25 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:01:25 user nova-compute[72780]:     </rng>
Aug 09 01:01:25 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:01:25 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:01:25 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:01:25 user nova-compute[72780]:     </memballoon>
Aug 09 01:01:25 user nova-compute[72780]:   </devices>
Aug 09 01:01:25 user nova-compute[72780]: </domain>
Aug 09 01:01:25 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7921795',id=24,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6SzWkdkeChpEDwfG/gb/UwilPvPkIV3DPHGWUF9DdJERtqoMO8p5+sH/BzanLtdhHHMi8gs3IpF4eCDmFK7uCHwUYt2MUHfUfTLneCbmUlgvWmLfHh4USNtcN8IrA31Q==',key_name='tempest-keypair-223497019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89ed02fd4f2445d292ae2d2ebf8d7bde',ramdisk_id='',reservation_id='r-p2znusi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1760079964',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b8b1600f374a0f93aa515a17e5fa32',uuid=bbe38c09-7b3d-481a-b414-d70a0f89332b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Converting VIF {"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG os_vif [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9441fd0c-53, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9441fd0c-53, col_values=(('external_ids', {'iface-id': '9441fd0c-536a-494e-83dd-6cba552ca2cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:2e:fe', 'vm-uuid': 'bbe38c09-7b3d-481a-b414-d70a0f89332b'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:25 user nova-compute[72780]: INFO os_vif [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53')
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] No VIF found with MAC fa:16:3e:93:2e:fe, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:01:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-28915c2c-2704-44dd-8334-7279c71ef9e4 req-4a1e21e4-e9ee-43f1-af65-692955d044f8 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-28915c2c-2704-44dd-8334-7279c71ef9e4 req-4a1e21e4-e9ee-43f1-af65-692955d044f8 service nova] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-28915c2c-2704-44dd-8334-7279c71ef9e4 req-4a1e21e4-e9ee-43f1-af65-692955d044f8 service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-28915c2c-2704-44dd-8334-7279c71ef9e4 req-4a1e21e4-e9ee-43f1-af65-692955d044f8 service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-28915c2c-2704-44dd-8334-7279c71ef9e4 req-4a1e21e4-e9ee-43f1-af65-692955d044f8 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] No waiting events found dispatching network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:26 user nova-compute[72780]: WARNING nova.compute.manager [req-28915c2c-2704-44dd-8334-7279c71ef9e4 req-4a1e21e4-e9ee-43f1-af65-692955d044f8 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received unexpected event network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb for instance with vm_state building and task_state spawning.
Aug 09 01:01:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542888.871624, bbe38c09-7b3d-481a-b414-d70a0f89332b => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] VM Resumed (Lifecycle Event)
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:01:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Instance spawned successfully.
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:01:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542888.8727715, bbe38c09-7b3d-481a-b414-d70a0f89332b => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] VM Started (Lifecycle Event)
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:01:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:01:28 user nova-compute[72780]: INFO nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 09 01:01:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-1181d9b9-6476-4d57-a776-5d7c1447b575 req-4f912f6a-e318-46e3-9146-4d7163d28ef8 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1181d9b9-6476-4d57-a776-5d7c1447b575 req-4f912f6a-e318-46e3-9146-4d7163d28ef8 service nova] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1181d9b9-6476-4d57-a776-5d7c1447b575 req-4f912f6a-e318-46e3-9146-4d7163d28ef8 service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1181d9b9-6476-4d57-a776-5d7c1447b575 req-4f912f6a-e318-46e3-9146-4d7163d28ef8 service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-1181d9b9-6476-4d57-a776-5d7c1447b575 req-4f912f6a-e318-46e3-9146-4d7163d28ef8 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] No waiting events found dispatching network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:29 user nova-compute[72780]: WARNING nova.compute.manager [req-1181d9b9-6476-4d57-a776-5d7c1447b575 req-4f912f6a-e318-46e3-9146-4d7163d28ef8 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received unexpected event network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb for instance with vm_state building and task_state spawning.
Aug 09 01:01:29 user nova-compute[72780]: INFO nova.compute.manager [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Took 7.25 seconds to build instance.
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ff1bc2ba-c945-417a-a0d3-1b1fcaf1ff7e tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "83789356-a9ab-43ad-8701-376569301904" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "83789356-a9ab-43ad-8701-376569301904" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "83789356-a9ab-43ad-8701-376569301904-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "83789356-a9ab-43ad-8701-376569301904-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "83789356-a9ab-43ad-8701-376569301904-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:29 user nova-compute[72780]: INFO nova.compute.manager [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Terminating instance
Aug 09 01:01:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f174f8c-901d-4c8d-9691-c83318247c9b req-4a4553a4-c156-4b9d-98ba-36e55c422126 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-vif-unplugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8f174f8c-901d-4c8d-9691-c83318247c9b req-4a4553a4-c156-4b9d-98ba-36e55c422126 service nova] Acquiring lock "83789356-a9ab-43ad-8701-376569301904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8f174f8c-901d-4c8d-9691-c83318247c9b req-4a4553a4-c156-4b9d-98ba-36e55c422126 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8f174f8c-901d-4c8d-9691-c83318247c9b req-4a4553a4-c156-4b9d-98ba-36e55c422126 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f174f8c-901d-4c8d-9691-c83318247c9b req-4a4553a4-c156-4b9d-98ba-36e55c422126 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] No waiting events found dispatching network-vif-unplugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8f174f8c-901d-4c8d-9691-c83318247c9b req-4a4553a4-c156-4b9d-98ba-36e55c422126 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-vif-unplugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 83789356-a9ab-43ad-8701-376569301904] Instance destroyed successfully.
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.objects.instance [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'resources' on Instance uuid 83789356-a9ab-43ad-8701-376569301904 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-420031786',display_name='tempest-VolumesAdminNegativeTest-server-420031786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-420031786',id=20,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1fde5f8ef464f538a9dc70257e30863',ramdisk_id='',reservation_id='r-jlq1v4yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-347119394',owner_user_name='tempest-VolumesAdminNegativeTest-347119394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:59:38Z,user_data=None,user_id='ee86238cbadd465a8d45b72b20b8f50d',uuid=83789356-a9ab-43ad-8701-376569301904,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converting VIF {"id": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "address": "fa:16:3e:e4:92:67", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bd4dc2-2e", "ovs_interfaceid": "c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG os_vif [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0bd4dc2-2e, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:30 user nova-compute[72780]: INFO os_vif [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:92:67,bridge_name='br-int',has_traffic_filtering=True,id=c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bd4dc2-2e')
Aug 09 01:01:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Deleting instance files /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904_del
Aug 09 01:01:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Deletion of /opt/stack/data/nova/instances/83789356-a9ab-43ad-8701-376569301904_del complete
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-changed-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Refreshing instance network info cache due to event network-changed-c52d0609-22d2-4cd8-9545-bbf8bd7b1683. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] Acquiring lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] Acquired lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Refreshing network info cache for port c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:01:30 user nova-compute[72780]: INFO nova.compute.manager [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: 83789356-a9ab-43ad-8701-376569301904] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 83789356-a9ab-43ad-8701-376569301904] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 83789356-a9ab-43ad-8701-376569301904] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:30 user nova-compute[72780]: INFO nova.compute.manager [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Terminating instance
Aug 09 01:01:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Updated VIF entry in instance network info cache for port c52d0609-22d2-4cd8-9545-bbf8bd7b1683. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Updating instance_info_cache with network_info: [{"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a7b1d04a-8447-4bdd-b7bd-2e53113eb886 req-3646133c-90c6-4318-b2d1-23331e1940ad service nova] Releasing lock "refresh_cache-7ec77892-5c0c-4599-9533-3d8628c4c3f9" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 83789356-a9ab-43ad-8701-376569301904] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 83789356-a9ab-43ad-8701-376569301904] Took 0.74 seconds to deallocate network for instance.
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Instance destroyed successfully.
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'resources' on Instance uuid 7ec77892-5c0c-4599-9533-3d8628c4c3f9 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-861012165',display_name='tempest-AttachVolumeNegativeTest-server-861012165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-861012165',id=21,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfDsczrdcYhjrhhfL2q9DXcDW2RByFxcPhXXm3t5eWzg27Sq0Khz4t4WRpTp8VNhsThZhiDFViDUVBYbiNu/6GU550IM/cK3Qw8PK4GUg7hEo8VZ0EP7wrQB4GSbSHl9w==',key_name='tempest-keypair-74257555',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-axexh0pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=7ec77892-5c0c-4599-9533-3d8628c4c3f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "address": "fa:16:3e:32:fa:b6", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52d0609-22", "ovs_interfaceid": "c52d0609-22d2-4cd8-9545-bbf8bd7b1683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG os_vif [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc52d0609-22, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:31 user nova-compute[72780]: INFO os_vif [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fa:b6,bridge_name='br-int',has_traffic_filtering=True,id=c52d0609-22d2-4cd8-9545-bbf8bd7b1683,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52d0609-22')
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Deleting instance files /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9_del
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Deletion of /opt/stack/data/nova/instances/7ec77892-5c0c-4599-9533-3d8628c4c3f9_del complete
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542876.80733, 1928c3a6-c836-4487-bc21-5eb902fb61fa => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] VM Stopped (Lifecycle Event)
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5e82f6ed-afa3-48fe-94ed-36aed8f2111a None None] [instance: 1928c3a6-c836-4487-bc21-5eb902fb61fa] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Deleted allocations for instance 83789356-a9ab-43ad-8701-376569301904
Aug 09 01:01:31 user nova-compute[72780]: INFO nova.compute.manager [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] Acquiring lock "83789356-a9ab-43ad-8701-376569301904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] Lock "83789356-a9ab-43ad-8701-376569301904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] No waiting events found dispatching network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:31 user nova-compute[72780]: WARNING nova.compute.manager [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received unexpected event network-vif-plugged-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab for instance with vm_state deleted and task_state None.
Aug 09 01:01:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-7104db41-bcf2-4818-8d7b-7af65472e27c req-5eb401fc-b963-49fd-a782-6b4762cb79c5 service nova] [instance: 83789356-a9ab-43ad-8701-376569301904] Received event network-vif-deleted-c0bd4dc2-2ed5-4af9-ae55-ec47a9b7ddab {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f5a3922a-314e-4126-b743-452245c5cf2e tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "83789356-a9ab-43ad-8701-376569301904" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-vif-unplugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] No waiting events found dispatching network-vif-unplugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-vif-unplugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] Acquiring lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] No waiting events found dispatching network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:32 user nova-compute[72780]: WARNING nova.compute.manager [req-795c9ff3-7148-44b9-b292-9828f1f2dba0 req-892008da-24ee-470c-95e5-e9f290afe5f7 service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received unexpected event network-vif-plugged-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 for instance with vm_state active and task_state deleting.
Aug 09 01:01:33 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:33 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Took 1.31 seconds to deallocate network for instance.
Aug 09 01:01:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:33 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:33 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Deleted allocations for instance 7ec77892-5c0c-4599-9533-3d8628c4c3f9
Aug 09 01:01:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d5bed4cb-29d3-4e07-818e-778027439f45 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "7ec77892-5c0c-4599-9533-3d8628c4c3f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.937s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-988aa5fd-0edd-47ba-adc8-8e3badfb3887 req-db6003fb-49a2-4c1f-bbeb-fdd979b8849e service nova] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Received event network-vif-deleted-c52d0609-22d2-4cd8-9545-bbf8bd7b1683 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-changed-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Refreshing instance network info cache due to event network-changed-80ff0d44-4460-40ea-b37a-21d59b3a80da. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] Acquiring lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] Acquired lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.network.neutron [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Refreshing network info cache for port 80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:36 user nova-compute[72780]: INFO nova.compute.manager [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Terminating instance
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-c3918315-d17a-4c00-bf4f-3c36c692e480 req-b2ab39bb-cf5e-4fc7-9f75-57660f4c8428 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-vif-unplugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c3918315-d17a-4c00-bf4f-3c36c692e480 req-b2ab39bb-cf5e-4fc7-9f75-57660f4c8428 service nova] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c3918315-d17a-4c00-bf4f-3c36c692e480 req-b2ab39bb-cf5e-4fc7-9f75-57660f4c8428 service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c3918315-d17a-4c00-bf4f-3c36c692e480 req-b2ab39bb-cf5e-4fc7-9f75-57660f4c8428 service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-c3918315-d17a-4c00-bf4f-3c36c692e480 req-b2ab39bb-cf5e-4fc7-9f75-57660f4c8428 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] No waiting events found dispatching network-vif-unplugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-c3918315-d17a-4c00-bf4f-3c36c692e480 req-b2ab39bb-cf5e-4fc7-9f75-57660f4c8428 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-vif-unplugged-80ff0d44-4460-40ea-b37a-21d59b3a80da for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Instance destroyed successfully.
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.objects.instance [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lazy-loading 'resources' on Instance uuid abc4a45e-2b7e-4038-9e67-a16a419e43bb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.network.neutron [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updated VIF entry in instance network info cache for port 80ff0d44-4460-40ea-b37a-21d59b3a80da. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.network.neutron [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating instance_info_cache with network_info: [{"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-84990694',display_name='tempest-TestStampPattern-server-84990694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84990694',id=11,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI07VMD4TclndvCxE6L38Kfcl2+xDDK4chst8IOjrrMvWh8Il4bIaWiI0srekfxk1YveAsel1TDoaTLMrNZK/VdAns7XVogJbCxdGHNJMvvjMwF4xr/mRlMFXTrSY23piA==',key_name='tempest-TestStampPattern-2067735695',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:54:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa1d9106ffe1447fa6b5ee6fbfc58417',ramdisk_id='',reservation_id='r-9hz96s5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-753935542',owner_user_name='tempest-TestStampPattern-753935542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:57:33Z,user_data=None,user_id='bade11d5ae3a4aa4bca3a34aa14298ce',uuid=abc4a45e-2b7e-4038-9e67-a16a419e43bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converting VIF {"id": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "address": "fa:16:3e:45:32:bd", "network": {"id": "a395bbcb-23ca-47aa-86db-897cf4604020", "bridge": "br-int", "label": "tempest-TestStampPattern-1595866446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1d9106ffe1447fa6b5ee6fbfc58417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ff0d44-44", "ovs_interfaceid": "80ff0d44-4460-40ea-b37a-21d59b3a80da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG os_vif [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80ff0d44-44, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-af761ae3-af6f-480b-a285-cd5d71de2d13 req-c2e5fe11-efd9-4695-957d-daa995ce2396 service nova] Releasing lock "refresh_cache-abc4a45e-2b7e-4038-9e67-a16a419e43bb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:01:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:01:36 user nova-compute[72780]: INFO os_vif [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:32:bd,bridge_name='br-int',has_traffic_filtering=True,id=80ff0d44-4460-40ea-b37a-21d59b3a80da,network=Network(a395bbcb-23ca-47aa-86db-897cf4604020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ff0d44-44')
Aug 09 01:01:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Deleting instance files /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb_del
Aug 09 01:01:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Deletion of /opt/stack/data/nova/instances/abc4a45e-2b7e-4038-9e67-a16a419e43bb_del complete
Aug 09 01:01:37 user nova-compute[72780]: INFO nova.compute.manager [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 01:01:37 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:01:37 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:01:37 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:01:37 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:01:37 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Took 0.73 seconds to deallocate network for instance.
Aug 09 01:01:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:38 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Deleted allocations for instance abc4a45e-2b7e-4038-9e67-a16a419e43bb
Aug 09 01:01:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-74da09ac-9070-4f3a-a676-11c667f8b5af tempest-TestStampPattern-753935542 tempest-TestStampPattern-753935542-project-member] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] Acquiring lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] Lock "abc4a45e-2b7e-4038-9e67-a16a419e43bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:01:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] No waiting events found dispatching network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:01:38 user nova-compute[72780]: WARNING nova.compute.manager [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received unexpected event network-vif-plugged-80ff0d44-4460-40ea-b37a-21d59b3a80da for instance with vm_state deleted and task_state None.
Aug 09 01:01:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-3f332383-ea8a-4f56-8f84-bfa85cc91e50 req-3034a530-eb48-407c-b5d0-4360f76fe08d service nova] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Received event network-vif-deleted-80ff0d44-4460-40ea-b37a-21d59b3a80da {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:01:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:45 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542890.3465073, 83789356-a9ab-43ad-8701-376569301904 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:45 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 83789356-a9ab-43ad-8701-376569301904] VM Stopped (Lifecycle Event)
Aug 09 01:01:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0df283c5-91ce-4afe-9d6b-d414d5d3e784 None None] [instance: 83789356-a9ab-43ad-8701-376569301904] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:46 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542891.668975, 7ec77892-5c0c-4599-9533-3d8628c4c3f9 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:46 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] VM Stopped (Lifecycle Event)
Aug 09 01:01:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-48e1099d-d0bd-400d-a1b0-f10c21e42f6f None None] [instance: 7ec77892-5c0c-4599-9533-3d8628c4c3f9] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:51 user nova-compute[72780]: INFO nova.compute.manager [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] instance snapshotting
Aug 09 01:01:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Beginning live snapshot process
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmfr9tk4j/b08056ef8e3240489f12bc1bd140f697.delta 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmfr9tk4j/b08056ef8e3240489f12bc1bd140f697.delta 1073741824" returned: 0 in 0.047s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 01:01:51 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542896.876855, abc4a45e-2b7e-4038-9e67-a16a419e43bb => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:01:51 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] VM Stopped (Lifecycle Event)
Aug 09 01:01:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-678a6d01-77f1-4055-bcd0-26e5f067ca29 None None] [instance: abc4a45e-2b7e-4038-9e67-a16a419e43bb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:01:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 01:01:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 01:01:53 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 01:01:53 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:01:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmfr9tk4j/b08056ef8e3240489f12bc1bd140f697.delta /opt/stack/data/nova/instances/snapshots/tmpmfr9tk4j/b08056ef8e3240489f12bc1bd140f697 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:01:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmfr9tk4j/b08056ef8e3240489f12bc1bd140f697.delta /opt/stack/data/nova/instances/snapshots/tmpmfr9tk4j/b08056ef8e3240489f12bc1bd140f697" returned: 0 in 0.674s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:01:53 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Snapshot extracted, beginning image upload
Aug 09 01:01:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:01:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Snapshot image upload complete
Aug 09 01:01:56 user nova-compute[72780]: INFO nova.compute.manager [None req-1c2360a1-d3c7-461a-af2e-12ca28a67e2d tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Took 4.93 seconds to snapshot the instance on the hypervisor.
Aug 09 01:01:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:02:01 user nova-compute[72780]: INFO nova.compute.claims [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Claim successful on node user
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:02:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.policy [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da43fc200f6044668eec95f723ec2486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2f203320294ed59055d5d0d3cf322a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:02:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Creating image(s)
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "/opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "/opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk 1073741824" returned: 0 in 0.109s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Successfully created port: 6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Cannot resize image /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lazy-loading 'migration_context' on Instance uuid 8fad1421-722b-4909-8b84-8cc8d69fd865 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Ensure instance console log exists: /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Successfully updated port: 6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "refresh_cache-8fad1421-722b-4909-8b84-8cc8d69fd865" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquired lock "refresh_cache-8fad1421-722b-4909-8b84-8cc8d69fd865" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-changed-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Refreshing instance network info cache due to event network-changed-6d6d402d-7bf9-466c-babe-15a812b7f23a. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] Acquiring lock "refresh_cache-8fad1421-722b-4909-8b84-8cc8d69fd865" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Updating instance_info_cache with network_info: [{"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Releasing lock "refresh_cache-8fad1421-722b-4909-8b84-8cc8d69fd865" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Instance network_info: |[{"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] Acquired lock "refresh_cache-8fad1421-722b-4909-8b84-8cc8d69fd865" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Refreshing network info cache for port 6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Start _get_guest_xml network_info=[{"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:02:03 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:03 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1871234648',display_name='tempest-VolumesActionsTest-instance-1871234648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1871234648',id=25,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2f203320294ed59055d5d0d3cf322a',ramdisk_id='',reservation_id='r-ta4vkyoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1675369655',owner_user_name='tempest-VolumesActionsTest-1675369655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:02:02Z,user_data=None,user_id='da43fc200f6044668eec95f723ec2486',uuid=8fad1421-722b-4909-8b84-8cc8d69fd865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converting VIF {"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fad1421-722b-4909-8b84-8cc8d69fd865 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:02:03 user nova-compute[72780]:   <uuid>8fad1421-722b-4909-8b84-8cc8d69fd865</uuid>
Aug 09 01:02:03 user nova-compute[72780]:   <name>instance-00000019</name>
Aug 09 01:02:03 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:02:03 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:02:03 user nova-compute[72780]:   <metadata>
Aug 09 01:02:03 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:02:03 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:02:03 user nova-compute[72780]:       <nova:name>tempest-VolumesActionsTest-instance-1871234648</nova:name>
Aug 09 01:02:03 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:02:03</nova:creationTime>
Aug 09 01:02:03 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:02:03 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:02:03 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:02:03 user nova-compute[72780]:       <nova:owner>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:user uuid="da43fc200f6044668eec95f723ec2486">tempest-VolumesActionsTest-1675369655-project-member</nova:user>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:project uuid="ee2f203320294ed59055d5d0d3cf322a">tempest-VolumesActionsTest-1675369655</nova:project>
Aug 09 01:02:03 user nova-compute[72780]:       </nova:owner>
Aug 09 01:02:03 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:02:03 user nova-compute[72780]:       <nova:ports>
Aug 09 01:02:03 user nova-compute[72780]:         <nova:port uuid="6d6d402d-7bf9-466c-babe-15a812b7f23a">
Aug 09 01:02:03 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 01:02:03 user nova-compute[72780]:         </nova:port>
Aug 09 01:02:03 user nova-compute[72780]:       </nova:ports>
Aug 09 01:02:03 user nova-compute[72780]:     </nova:instance>
Aug 09 01:02:03 user nova-compute[72780]:   </metadata>
Aug 09 01:02:03 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:02:03 user nova-compute[72780]:     <system>
Aug 09 01:02:03 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:02:03 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:02:03 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:02:03 user nova-compute[72780]:       <entry name="serial">8fad1421-722b-4909-8b84-8cc8d69fd865</entry>
Aug 09 01:02:03 user nova-compute[72780]:       <entry name="uuid">8fad1421-722b-4909-8b84-8cc8d69fd865</entry>
Aug 09 01:02:03 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:02:03 user nova-compute[72780]:     </system>
Aug 09 01:02:03 user nova-compute[72780]:   </sysinfo>
Aug 09 01:02:03 user nova-compute[72780]:   <os>
Aug 09 01:02:03 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:02:03 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:02:03 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:02:03 user nova-compute[72780]:   </os>
Aug 09 01:02:03 user nova-compute[72780]:   <features>
Aug 09 01:02:03 user nova-compute[72780]:     <acpi/>
Aug 09 01:02:03 user nova-compute[72780]:     <apic/>
Aug 09 01:02:03 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:02:03 user nova-compute[72780]:   </features>
Aug 09 01:02:03 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:02:03 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:02:03 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:02:03 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:02:03 user nova-compute[72780]:   </clock>
Aug 09 01:02:03 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:02:03 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:02:03 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:02:03 user nova-compute[72780]:   </cpu>
Aug 09 01:02:03 user nova-compute[72780]:   <devices>
Aug 09 01:02:03 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:02:03 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:02:03 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk"/>
Aug 09 01:02:03 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:02:03 user nova-compute[72780]:     </disk>
Aug 09 01:02:03 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:02:03 user nova-compute[72780]:       <mac address="fa:16:3e:f7:b5:44"/>
Aug 09 01:02:03 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:02:03 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:02:03 user nova-compute[72780]:       <target dev="tap6d6d402d-7b"/>
Aug 09 01:02:03 user nova-compute[72780]:     </interface>
Aug 09 01:02:03 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:02:03 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/console.log" append="off"/>
Aug 09 01:02:03 user nova-compute[72780]:     </serial>
Aug 09 01:02:03 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:02:03 user nova-compute[72780]:     <video>
Aug 09 01:02:03 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:02:03 user nova-compute[72780]:     </video>
Aug 09 01:02:03 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:02:03 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:02:03 user nova-compute[72780]:     </rng>
Aug 09 01:02:03 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:02:03 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:02:03 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:02:03 user nova-compute[72780]:     </memballoon>
Aug 09 01:02:03 user nova-compute[72780]:   </devices>
Aug 09 01:02:03 user nova-compute[72780]: </domain>
Aug 09 01:02:03 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1871234648',display_name='tempest-VolumesActionsTest-instance-1871234648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1871234648',id=25,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2f203320294ed59055d5d0d3cf322a',ramdisk_id='',reservation_id='r-ta4vkyoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1675369655',owner_user_name='tempest-VolumesActionsTest-1675369655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:02:02Z,user_data=None,user_id='da43fc200f6044668eec95f723ec2486',uuid=8fad1421-722b-4909-8b84-8cc8d69fd865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converting VIF {"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG os_vif [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d6d402d-7b, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d6d402d-7b, col_values=(('external_ids', {'iface-id': '6d6d402d-7bf9-466c-babe-15a812b7f23a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:b5:44', 'vm-uuid': '8fad1421-722b-4909-8b84-8cc8d69fd865'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:03 user nova-compute[72780]: INFO os_vif [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b')
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] No VIF found with MAC fa:16:3e:f7:b5:44, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Updated VIF entry in instance network info cache for port 6d6d402d-7bf9-466c-babe-15a812b7f23a. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Updating instance_info_cache with network_info: [{"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-333d21c2-a45a-4ab4-8264-28a3ce4b9b0d req-4e84bc80-ebdf-4ee8-a353-ceb97f746dda service nova] Releasing lock "refresh_cache-8fad1421-722b-4909-8b84-8cc8d69fd865" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-479f843e-e70e-4516-9b9f-cd242cc0e882 req-bbe5e2b8-fa39-456e-b214-a4c3dfee961d service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-479f843e-e70e-4516-9b9f-cd242cc0e882 req-bbe5e2b8-fa39-456e-b214-a4c3dfee961d service nova] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-479f843e-e70e-4516-9b9f-cd242cc0e882 req-bbe5e2b8-fa39-456e-b214-a4c3dfee961d service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-479f843e-e70e-4516-9b9f-cd242cc0e882 req-bbe5e2b8-fa39-456e-b214-a4c3dfee961d service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-479f843e-e70e-4516-9b9f-cd242cc0e882 req-bbe5e2b8-fa39-456e-b214-a4c3dfee961d service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] No waiting events found dispatching network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:05 user nova-compute[72780]: WARNING nova.compute.manager [req-479f843e-e70e-4516-9b9f-cd242cc0e882 req-bbe5e2b8-fa39-456e-b214-a4c3dfee961d service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received unexpected event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a for instance with vm_state building and task_state spawning.
Aug 09 01:02:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542926.893002, 8fad1421-722b-4909-8b84-8cc8d69fd865 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] VM Resumed (Lifecycle Event)
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:02:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Instance spawned successfully.
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542926.8945558, 8fad1421-722b-4909-8b84-8cc8d69fd865 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] VM Started (Lifecycle Event)
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:02:06 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:02:07 user nova-compute[72780]: INFO nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 09 01:02:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:07 user nova-compute[72780]: INFO nova.compute.manager [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Took 6.01 seconds to build instance.
Aug 09 01:02:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a1d2ee1e-a6ed-423b-8192-4b40460962f5 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.106s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-07c972dd-077c-4f9e-adb4-411cf961eccf req-243c0a8c-1d94-4f06-81fb-56e297c1c5ca service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07c972dd-077c-4f9e-adb4-411cf961eccf req-243c0a8c-1d94-4f06-81fb-56e297c1c5ca service nova] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07c972dd-077c-4f9e-adb4-411cf961eccf req-243c0a8c-1d94-4f06-81fb-56e297c1c5ca service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07c972dd-077c-4f9e-adb4-411cf961eccf req-243c0a8c-1d94-4f06-81fb-56e297c1c5ca service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-07c972dd-077c-4f9e-adb4-411cf961eccf req-243c0a8c-1d94-4f06-81fb-56e297c1c5ca service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] No waiting events found dispatching network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:07 user nova-compute[72780]: WARNING nova.compute.manager [req-07c972dd-077c-4f9e-adb4-411cf961eccf req-243c0a8c-1d94-4f06-81fb-56e297c1c5ca service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received unexpected event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a for instance with vm_state active and task_state None.
Aug 09 01:02:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:02:10 user nova-compute[72780]: INFO nova.compute.claims [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Claim successful on node user
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:02:11 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-changed-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Refreshing instance network info cache due to event network-changed-94a22dc3-1499-42f5-8229-ce152758ea73. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Refreshing network info cache for port 94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.policy [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f38504b4e824e7ea66ab9e8c56f0b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ce26fa1a3947488856bfd876571471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:02:11 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Creating image(s)
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "/opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "/opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "/opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk 1073741824" returned: 0 in 0.053s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updated VIF entry in instance network info cache for port 94a22dc3-1499-42f5-8229-ce152758ea73. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b34b1fe0-3236-4e8f-b3b9-40033b96f1bc req-c09d7f2c-b74e-4021-a84e-3fd9922037a2 service nova] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Cannot resize image /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'migration_context' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Ensure instance console log exists: /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Successfully created port: 9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Stashing vm_state: active {{(pid=72780) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'pci_requests' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:02:12 user nova-compute[72780]: INFO nova.compute.claims [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Claim successful on node user
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'resources' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'pci_devices' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:13 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating resource usage from migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.497s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:13 user nova-compute[72780]: INFO nova.compute.manager [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Migrating
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquired lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-changed-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Refreshing instance network info cache due to event network-changed-3fc7961c-9c92-47fe-bc61-522c26fb2e70. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] Acquiring lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Successfully updated port: 9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquired lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-changed-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Refreshing instance network info cache due to event network-changed-9995e7c0-cfda-4997-9c7e-0df5fb8b751b. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] Acquiring lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updating instance_info_cache with network_info: [{"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Releasing lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Instance network_info: |[{"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] Acquired lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Refreshing network info cache for port 9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Start _get_guest_xml network_info=[{"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:02:13 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:13 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1342460866',display_name='tempest-AttachVolumeTestJSON-server-1342460866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1342460866',id=26,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL11FueI/S3bjAvZUcjRlwMaiD8yngpeo0ZMzs91x4ciX4HXBuEQ42ZMoIvB6rb7rQ9/62/BIuJK8ogHsxAnY9qmKZh5A3eMPugcRtuBwOJyZWo4ZmRGGGXbwU9tiu1SA==',key_name='tempest-keypair-821442165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-c0z6xup4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=318b5ce7-b2af-4d57-a158-070713c3ebc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'pci_devices' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:02:13 user nova-compute[72780]:   <uuid>318b5ce7-b2af-4d57-a158-070713c3ebc7</uuid>
Aug 09 01:02:13 user nova-compute[72780]:   <name>instance-0000001a</name>
Aug 09 01:02:13 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:02:13 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:02:13 user nova-compute[72780]:   <metadata>
Aug 09 01:02:13 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:02:13 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:02:13 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeTestJSON-server-1342460866</nova:name>
Aug 09 01:02:13 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:02:13</nova:creationTime>
Aug 09 01:02:13 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:02:13 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:02:13 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:02:13 user nova-compute[72780]:       <nova:owner>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:user uuid="3f38504b4e824e7ea66ab9e8c56f0b50">tempest-AttachVolumeTestJSON-760573544-project-member</nova:user>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:project uuid="32ce26fa1a3947488856bfd876571471">tempest-AttachVolumeTestJSON-760573544</nova:project>
Aug 09 01:02:13 user nova-compute[72780]:       </nova:owner>
Aug 09 01:02:13 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:02:13 user nova-compute[72780]:       <nova:ports>
Aug 09 01:02:13 user nova-compute[72780]:         <nova:port uuid="9995e7c0-cfda-4997-9c7e-0df5fb8b751b">
Aug 09 01:02:13 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 01:02:13 user nova-compute[72780]:         </nova:port>
Aug 09 01:02:13 user nova-compute[72780]:       </nova:ports>
Aug 09 01:02:13 user nova-compute[72780]:     </nova:instance>
Aug 09 01:02:13 user nova-compute[72780]:   </metadata>
Aug 09 01:02:13 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:02:13 user nova-compute[72780]:     <system>
Aug 09 01:02:13 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:02:13 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:02:13 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:02:13 user nova-compute[72780]:       <entry name="serial">318b5ce7-b2af-4d57-a158-070713c3ebc7</entry>
Aug 09 01:02:13 user nova-compute[72780]:       <entry name="uuid">318b5ce7-b2af-4d57-a158-070713c3ebc7</entry>
Aug 09 01:02:13 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:02:13 user nova-compute[72780]:     </system>
Aug 09 01:02:13 user nova-compute[72780]:   </sysinfo>
Aug 09 01:02:13 user nova-compute[72780]:   <os>
Aug 09 01:02:13 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:02:13 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:02:13 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:02:13 user nova-compute[72780]:   </os>
Aug 09 01:02:13 user nova-compute[72780]:   <features>
Aug 09 01:02:13 user nova-compute[72780]:     <acpi/>
Aug 09 01:02:13 user nova-compute[72780]:     <apic/>
Aug 09 01:02:13 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:02:13 user nova-compute[72780]:   </features>
Aug 09 01:02:13 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:02:13 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:02:13 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:02:13 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:02:13 user nova-compute[72780]:   </clock>
Aug 09 01:02:13 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:02:13 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:02:13 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:02:13 user nova-compute[72780]:   </cpu>
Aug 09 01:02:13 user nova-compute[72780]:   <devices>
Aug 09 01:02:13 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:02:13 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:02:13 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk"/>
Aug 09 01:02:13 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:02:13 user nova-compute[72780]:     </disk>
Aug 09 01:02:13 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:02:13 user nova-compute[72780]:       <mac address="fa:16:3e:98:d9:2a"/>
Aug 09 01:02:13 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:02:13 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:02:13 user nova-compute[72780]:       <target dev="tap9995e7c0-cf"/>
Aug 09 01:02:13 user nova-compute[72780]:     </interface>
Aug 09 01:02:13 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:02:13 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/console.log" append="off"/>
Aug 09 01:02:13 user nova-compute[72780]:     </serial>
Aug 09 01:02:13 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:02:13 user nova-compute[72780]:     <video>
Aug 09 01:02:13 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:02:13 user nova-compute[72780]:     </video>
Aug 09 01:02:13 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:02:13 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:02:13 user nova-compute[72780]:     </rng>
Aug 09 01:02:13 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:02:13 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:02:13 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:02:13 user nova-compute[72780]:     </memballoon>
Aug 09 01:02:13 user nova-compute[72780]:   </devices>
Aug 09 01:02:13 user nova-compute[72780]: </domain>
Aug 09 01:02:13 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1342460866',display_name='tempest-AttachVolumeTestJSON-server-1342460866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1342460866',id=26,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL11FueI/S3bjAvZUcjRlwMaiD8yngpeo0ZMzs91x4ciX4HXBuEQ42ZMoIvB6rb7rQ9/62/BIuJK8ogHsxAnY9qmKZh5A3eMPugcRtuBwOJyZWo4ZmRGGGXbwU9tiu1SA==',key_name='tempest-keypair-821442165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-c0z6xup4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=318b5ce7-b2af-4d57-a158-070713c3ebc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG os_vif [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Releasing lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] Acquired lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Refreshing network info cache for port 3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9995e7c0-cf, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9995e7c0-cf, col_values=(('external_ids', {'iface-id': '9995e7c0-cfda-4997-9c7e-0df5fb8b751b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:d9:2a', 'vm-uuid': '318b5ce7-b2af-4d57-a158-070713c3ebc7'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: INFO os_vif [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf')
Aug 09 01:02:14 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No VIF found with MAC fa:16:3e:98:d9:2a, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Starting migrate_disk_and_power_off {{(pid=72780) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updated VIF entry in instance network info cache for port 9995e7c0-cfda-4997-9c7e-0df5fb8b751b. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updating instance_info_cache with network_info: [{"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-42b07793-cdcc-4e0a-8853-62a7b713e431 req-911ecba3-5af1-4f53-a42a-1f59c22a6875 service nova] Releasing lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updated VIF entry in instance network info cache for port 3fc7961c-9c92-47fe-bc61-522c26fb2e70. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2fbbbc8d-405a-4f1a-9427-abfcfc44b331 req-56637f93-6b45-4995-9687-4bd790b8e263 service nova] Releasing lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:15 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance destroyed successfully.
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419978631',display_name='tempest-ServerActionsTestOtherA-server-419978631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419978631',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-y0t2dcnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=6515b699-7198-4fca-b3f5-30eeb70bf3b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fc7961c-9c, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:15 user nova-compute[72780]: INFO os_vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c')
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:02:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[687fb044-3fd6-4246-8052-1a6c816a47fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1539885-f86a-4cf8-8573-6173409fe224]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:15 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:02:15 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:02:15 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:15 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:02:15 user nova-compute[72780]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:02:15 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01e0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc362e0-1b42-44f2-9e3c-805e02e298aa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ffc6be-b1c6-47fa-a071-0052a5fc310e]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-unplugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-unplugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:15 user nova-compute[72780]: WARNING nova.compute.manager [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-unplugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state active and task_state resize_migrating.
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:15 user nova-compute[72780]: WARNING nova.compute.manager [req-c5168247-235d-448b-80c4-77cdfb877c63 req-30c756bd-874c-4c4f-b361-5883727e2101 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state active and task_state resize_migrating.
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb416c22-69ef-4185-ba28-f46372af0dbe]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dfd029-cc7c-4334-aae0-dbe4390d1104]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa3def-fae3-4a4b-9902-fd9ab370b5f0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df13759-b99c-42fc-9bf8-91a0cc36d481]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]
Aug 09 01:02:15 user nova-compute[72780]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.
Aug 09 01:02:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea064ee1-514a-46e1-85d1-77e7c6504f0c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== disconnect_volume: return (343ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:02:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Port 3fc7961c-9c92-47fe-bc61-522c26fb2e70 binding to destination host user is already ACTIVE {{(pid=72780) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquired lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] No waiting events found dispatching network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:17 user nova-compute[72780]: WARNING nova.compute.manager [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received unexpected event network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b for instance with vm_state building and task_state spawning.
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] No waiting events found dispatching network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:17 user nova-compute[72780]: WARNING nova.compute.manager [req-9ce683e3-077b-4bb4-9d3e-19ad37495f39 req-894122fd-9ba6-422f-868d-850c7875a839 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received unexpected event network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b for instance with vm_state building and task_state spawning.
Aug 09 01:02:17 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Releasing lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG os_brick.utils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24731f6-aeed-4361-93fc-531653941f4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[759056c3-150a-4b47-b550-7eea273e3b84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5290ff89-2c11-4bf2-bb29-bdbbb4451ea2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5719fd-5c00-4395-a5dc-4e8c3cc1ffe4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:02:17 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:02:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c5065-9f4d-4b9e-b504-ee50dd85093a]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:02:17 user nova-compute[72780]: DEBUG os_brick.utils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542938.025797, 318b5ce7-b2af-4d57-a158-070713c3ebc7 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] VM Resumed (Lifecycle Event)
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Instance spawned successfully.
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542938.0269449, 318b5ce7-b2af-4d57-a158-070713c3ebc7 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] VM Started (Lifecycle Event)
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:18 user nova-compute[72780]: INFO nova.compute.manager [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Took 7.49 seconds to build instance.
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7252a1-8234-40ef-97e2-8377d575c851 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.589s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [{"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-9f271642-610f-451a-b6e1-159f2cf3523c" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:02:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:02:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: INFO nova.compute.manager [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Detaching volume 9739ea2e-4b04-4f39-aa42-c9214096b529
Aug 09 01:02:22 user nova-compute[72780]: INFO nova.virt.block_device [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Attempting to driver detach volume 9739ea2e-4b04-4f39-aa42-c9214096b529 from mountpoint /dev/vdb
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Attempting to detach device vdb from instance a35ae1e9-1559-41c8-8476-d571b679c084 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:02:22 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:02:22 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:02:22 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:02:22 user nova-compute[72780]:   <serial>9739ea2e-4b04-4f39-aa42-c9214096b529</serial>
Aug 09 01:02:22 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:02:22 user nova-compute[72780]: </disk>
Aug 09 01:02:22 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:02:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully detached device vdb from instance a35ae1e9-1559-41c8-8476-d571b679c084 from the persistent domain config.
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a35ae1e9-1559-41c8-8476-d571b679c084 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:02:22 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:02:22 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:02:22 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:02:22 user nova-compute[72780]:   <serial>9739ea2e-4b04-4f39-aa42-c9214096b529</serial>
Aug 09 01:02:22 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:02:22 user nova-compute[72780]: </disk>
Aug 09 01:02:22 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691542942.930075, a35ae1e9-1559-41c8-8476-d571b679c084 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully detached device vdb from instance a35ae1e9-1559-41c8-8476-d571b679c084 from the live domain config.
Aug 09 01:02:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSqNzBwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:02:22 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:02:22 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:22 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c321783-2a37-4f32-bf7f-d03ac803f2c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95787cf-9330-4cf4-a496-04468e9b2d9a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:23 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:02:23 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:23 user nova-compute[72780]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 (non-flash)
Aug 09 01:02:23 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01afb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d8b16-c3da-49cf-8fc2-d2233b2e53f6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feb96d2-3e84-4f8e-aa17-92cfb32f339b]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a4b736-5261-40db-8c9a-b6136e6ba2d8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfccf769-315e-4e4e-af5a-f1cbb8179a71]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bba04d-93b2-4102-ad80-0dac4f082d49]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc22386-16d3-42e2-9a59-52f6689cad60]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260]
Aug 09 01:02:23 user nova-compute[72780]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529, portal: 172.16.0.220,3260] successful.
Aug 09 01:02:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9739ea2e-4b04-4f39-aa42-c9214096b529 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef9fdc-894c-48a9-a4d9-d6da939c164c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== disconnect_volume: return (370ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-411907f0-9046-436d-8a95-863c311d3bbd tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.991s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7498MB free_disk=25.169849395751953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Applying migration context for instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 as it has an incoming, in-progress migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5. Migration status is post-migrating {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 01:02:24 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating resource usage from migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance deec36f5-a323-4595-b87a-abc995824040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a35ae1e9-1559-41c8-8476-d571b679c084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance bbe38c09-7b3d-481a-b414-d70a0f89332b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8fad1421-722b-4909-8b84-8cc8d69fd865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:02:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:25 user nova-compute[72780]: INFO nova.compute.manager [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Terminating instance
Aug 09 01:02:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-c76efa23-beb7-4b42-8c62-254787cc0082 req-280aeb3c-3039-47fe-ad0b-bd17756c781c service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-vif-unplugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c76efa23-beb7-4b42-8c62-254787cc0082 req-280aeb3c-3039-47fe-ad0b-bd17756c781c service nova] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c76efa23-beb7-4b42-8c62-254787cc0082 req-280aeb3c-3039-47fe-ad0b-bd17756c781c service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c76efa23-beb7-4b42-8c62-254787cc0082 req-280aeb3c-3039-47fe-ad0b-bd17756c781c service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-c76efa23-beb7-4b42-8c62-254787cc0082 req-280aeb3c-3039-47fe-ad0b-bd17756c781c service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] No waiting events found dispatching network-vif-unplugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-c76efa23-beb7-4b42-8c62-254787cc0082 req-280aeb3c-3039-47fe-ad0b-bd17756c781c service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-vif-unplugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:02:26 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: deec36f5-a323-4595-b87a-abc995824040] Instance destroyed successfully.
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lazy-loading 'resources' on Instance uuid deec36f5-a323-4595-b87a-abc995824040 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:56:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1520795590',display_name='tempest-VolumesAdminNegativeTest-server-1520795590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1520795590',id=14,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS2ZzAuGtt11hXvPMmvbQLPCZf0Xb9DnF6T3WXNF4XRM4zWQwZl/l5whuhF4UcJaCkbiEqqDlU/85b57PVKMj7Pbl9Hqli9wZz8/MGW7ssNI2lIRFdOMmL2WsQX6iXDjw==',key_name='tempest-keypair-161214364',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:56:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1fde5f8ef464f538a9dc70257e30863',ramdisk_id='',reservation_id='r-h1p5h9m7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-347119394',owner_user_name='tempest-VolumesAdminNegativeTest-347119394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:56:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee86238cbadd465a8d45b72b20b8f50d',uuid=deec36f5-a323-4595-b87a-abc995824040,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converting VIF {"id": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "address": "fa:16:3e:a6:68:ec", "network": {"id": "7463383e-0366-4d10-a831-3047c979a072", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-704942004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1fde5f8ef464f538a9dc70257e30863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfb9c3d-dc", "ovs_interfaceid": "adfb9c3d-dc70-4459-bb67-7456bb6281ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG os_vif [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadfb9c3d-dc, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:26 user nova-compute[72780]: INFO os_vif [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:68:ec,bridge_name='br-int',has_traffic_filtering=True,id=adfb9c3d-dc70-4459-bb67-7456bb6281ea,network=Network(7463383e-0366-4d10-a831-3047c979a072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfb9c3d-dc')
Aug 09 01:02:26 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Deleting instance files /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040_del
Aug 09 01:02:26 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Deletion of /opt/stack/data/nova/instances/deec36f5-a323-4595-b87a-abc995824040_del complete
Aug 09 01:02:26 user nova-compute[72780]: INFO nova.compute.manager [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] [instance: deec36f5-a323-4595-b87a-abc995824040] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: deec36f5-a323-4595-b87a-abc995824040] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: deec36f5-a323-4595-b87a-abc995824040] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Starting finish_migration {{(pid=72780) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 01:02:26 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Creating image(s)
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Ensure instance console log exists: /opt/stack/data/nova/instances/6515b699-7198-4fca-b3f5-30eeb70bf3b1/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Start _get_guest_xml network_info=[{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6515b699-7198-4fca-b3f5-30eeb70bf3b1', 'attached_at': '2023-08-09T01:02:27.000000', 'detached_at': '', 'volume_id': 'ac7fbb21-ba2f-469c-bfbd-60f69ac5af04', 'serial': 'ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'}, 'disk_bus': 'virtio', 'attachment_id': 'c4b1a626-fa0d-4335-8051-e3c04d603766', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:02:26 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:26 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:02:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:02:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:02:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:02:27 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa6f9d-9a16-443e-9c41-bcaddba40b28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:02:27 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967061f-6954-4e15-b88d-322defbebb59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04] added
Aug 09 01:02:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a991392-92f3-41c1-8f93-d330d3abc257]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab5210d-09fa-4a3d-ae4b-81c6abc14bc6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwzxSQr {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfwzxSQr" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0544ab8-9a3c-475f-bc74-047137d8c366]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hfwzxSQr'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[98408425-275e-4e58-87dd-2d0cb63bc4fd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3dd79-11e6-44f1-8d1e-eadd3cb9fe22]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d798e-ef1f-49c4-b8fe-da75753530b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]
Aug 09 01:02:27 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.
Aug 09 01:02:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82695fd9-857a-41fb-9bad-05cbb9b69769]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3370fb-3bec-4459-8f57-bc835ddd83db]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:27 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:02:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:02:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:02:27 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:02:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d6bd78-d43e-4916-8869-26f31ba33506]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: deec36f5-a323-4595-b87a-abc995824040] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-9fbde20d-b9f3-41ad-a75d-d9d47c3ca5e2 req-dd7bb371-94ff-47f5-af87-3ee5f8da7dd9 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-vif-deleted-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:27 user nova-compute[72780]: INFO nova.compute.manager [req-9fbde20d-b9f3-41ad-a75d-d9d47c3ca5e2 req-dd7bb371-94ff-47f5-af87-3ee5f8da7dd9 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Neutron deleted interface adfb9c3d-dc70-4459-bb67-7456bb6281ea; detaching it from the instance and deleting it from the info cache
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.network.neutron [req-9fbde20d-b9f3-41ad-a75d-d9d47c3ca5e2 req-dd7bb371-94ff-47f5-af87-3ee5f8da7dd9 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:02:27 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: deec36f5-a323-4595-b87a-abc995824040] Took 0.99 seconds to deallocate network for instance.
Aug 09 01:02:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-9fbde20d-b9f3-41ad-a75d-d9d47c3ca5e2 req-dd7bb371-94ff-47f5-af87-3ee5f8da7dd9 service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Detach interface failed, port_id=adfb9c3d-dc70-4459-bb67-7456bb6281ea, reason: Instance deec36f5-a323-4595-b87a-abc995824040 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:28 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Deleted allocations for instance deec36f5-a323-4595-b87a-abc995824040
Aug 09 01:02:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fc13fa21-1133-41d6-a01a-5d6e4c50fcdb tempest-VolumesAdminNegativeTest-347119394 tempest-VolumesAdminNegativeTest-347119394-project-member] Lock "deec36f5-a323-4595-b87a-abc995824040" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-d3884105-02a6-4552-907d-b2a95ac7a5b6 req-726bfa97-70e8-4842-8f00-058d217fd53e service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received event network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d3884105-02a6-4552-907d-b2a95ac7a5b6 req-726bfa97-70e8-4842-8f00-058d217fd53e service nova] Acquiring lock "deec36f5-a323-4595-b87a-abc995824040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d3884105-02a6-4552-907d-b2a95ac7a5b6 req-726bfa97-70e8-4842-8f00-058d217fd53e service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d3884105-02a6-4552-907d-b2a95ac7a5b6 req-726bfa97-70e8-4842-8f00-058d217fd53e service nova] Lock "deec36f5-a323-4595-b87a-abc995824040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-d3884105-02a6-4552-907d-b2a95ac7a5b6 req-726bfa97-70e8-4842-8f00-058d217fd53e service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] No waiting events found dispatching network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:28 user nova-compute[72780]: WARNING nova.compute.manager [req-d3884105-02a6-4552-907d-b2a95ac7a5b6 req-726bfa97-70e8-4842-8f00-058d217fd53e service nova] [instance: deec36f5-a323-4595-b87a-abc995824040] Received unexpected event network-vif-plugged-adfb9c3d-dc70-4459-bb67-7456bb6281ea for instance with vm_state deleted and task_state None.
Aug 09 01:02:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26632663463346432', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663463346432', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419978631',display_name='tempest-ServerActionsTestOtherA-server-419978631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419978631',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-y0t2dcnt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=6515b699-7198-4fca-b3f5-30eeb70bf3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:02:28 user nova-compute[72780]:   <uuid>6515b699-7198-4fca-b3f5-30eeb70bf3b1</uuid>
Aug 09 01:02:28 user nova-compute[72780]:   <name>instance-00000017</name>
Aug 09 01:02:28 user nova-compute[72780]:   <memory>2097152</memory>
Aug 09 01:02:28 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:02:28 user nova-compute[72780]:   <metadata>
Aug 09 01:02:28 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:02:28 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:02:28 user nova-compute[72780]:       <nova:name>tempest-ServerActionsTestOtherA-server-419978631</nova:name>
Aug 09 01:02:28 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:02:26</nova:creationTime>
Aug 09 01:02:28 user nova-compute[72780]:       <nova:flavor name="m1.small">
Aug 09 01:02:28 user nova-compute[72780]:         <nova:memory>2048</nova:memory>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:disk>20</nova:disk>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:02:28 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:02:28 user nova-compute[72780]:       <nova:owner>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:user uuid="8412204a685048a6a787793a7266f085">tempest-ServerActionsTestOtherA-1294078380-project-member</nova:user>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:project uuid="8eb0278ced1640e9a1ab66e5cfcafc8f">tempest-ServerActionsTestOtherA-1294078380</nova:project>
Aug 09 01:02:28 user nova-compute[72780]:       </nova:owner>
Aug 09 01:02:28 user nova-compute[72780]:       <nova:ports>
Aug 09 01:02:28 user nova-compute[72780]:         <nova:port uuid="3fc7961c-9c92-47fe-bc61-522c26fb2e70">
Aug 09 01:02:28 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 01:02:28 user nova-compute[72780]:         </nova:port>
Aug 09 01:02:28 user nova-compute[72780]:       </nova:ports>
Aug 09 01:02:28 user nova-compute[72780]:     </nova:instance>
Aug 09 01:02:28 user nova-compute[72780]:   </metadata>
Aug 09 01:02:28 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:02:28 user nova-compute[72780]:     <system>
Aug 09 01:02:28 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:02:28 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:02:28 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:02:28 user nova-compute[72780]:       <entry name="serial">6515b699-7198-4fca-b3f5-30eeb70bf3b1</entry>
Aug 09 01:02:28 user nova-compute[72780]:       <entry name="uuid">6515b699-7198-4fca-b3f5-30eeb70bf3b1</entry>
Aug 09 01:02:28 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:02:28 user nova-compute[72780]:     </system>
Aug 09 01:02:28 user nova-compute[72780]:   </sysinfo>
Aug 09 01:02:28 user nova-compute[72780]:   <os>
Aug 09 01:02:28 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:02:28 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:02:28 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:02:28 user nova-compute[72780]:   </os>
Aug 09 01:02:28 user nova-compute[72780]:   <features>
Aug 09 01:02:28 user nova-compute[72780]:     <acpi/>
Aug 09 01:02:28 user nova-compute[72780]:     <apic/>
Aug 09 01:02:28 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:02:28 user nova-compute[72780]:   </features>
Aug 09 01:02:28 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:02:28 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:02:28 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:02:28 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:02:28 user nova-compute[72780]:   </clock>
Aug 09 01:02:28 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:02:28 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:02:28 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:02:28 user nova-compute[72780]:   </cpu>
Aug 09 01:02:28 user nova-compute[72780]:   <devices>
Aug 09 01:02:28 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:02:28 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:02:28 user nova-compute[72780]:       <source dev="/dev/sdc"/>
Aug 09 01:02:28 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:02:28 user nova-compute[72780]:       <serial>ac7fbb21-ba2f-469c-bfbd-60f69ac5af04</serial>
Aug 09 01:02:28 user nova-compute[72780]:     </disk>
Aug 09 01:02:28 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:02:28 user nova-compute[72780]:       <mac address="fa:16:3e:9e:70:a5"/>
Aug 09 01:02:28 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:02:28 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:02:28 user nova-compute[72780]:       <target dev="tap3fc7961c-9c"/>
Aug 09 01:02:28 user nova-compute[72780]:     </interface>
Aug 09 01:02:28 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:02:28 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/6515b699-7198-4fca-b3f5-30eeb70bf3b1/console.log" append="off"/>
Aug 09 01:02:28 user nova-compute[72780]:     </serial>
Aug 09 01:02:28 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:02:28 user nova-compute[72780]:     <video>
Aug 09 01:02:28 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:02:28 user nova-compute[72780]:     </video>
Aug 09 01:02:28 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:02:28 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:02:28 user nova-compute[72780]:     </rng>
Aug 09 01:02:28 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:02:28 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:02:28 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:02:28 user nova-compute[72780]:     </memballoon>
Aug 09 01:02:28 user nova-compute[72780]:   </devices>
Aug 09 01:02:28 user nova-compute[72780]: </domain>
Aug 09 01:02:28 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419978631',display_name='tempest-ServerActionsTestOtherA-server-419978631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419978631',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-y0t2dcnt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=6515b699-7198-4fca-b3f5-30eeb70bf3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1944907576-network", "vif_mac": "fa:16:3e:9e:70:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG os_vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fc7961c-9c, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fc7961c-9c, col_values=(('external_ids', {'iface-id': '3fc7961c-9c92-47fe-bc61-522c26fb2e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:70:a5', 'vm-uuid': '6515b699-7198-4fca-b3f5-30eeb70bf3b1'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:28 user nova-compute[72780]: INFO os_vif [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c')
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:02:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] No VIF found with MAC fa:16:3e:9e:70:a5, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:02:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-ebd6eade-30b0-467d-8b74-865c52c008bf req-56f2daf5-c90f-4817-95a1-979d71f96144 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ebd6eade-30b0-467d-8b74-865c52c008bf req-56f2daf5-c90f-4817-95a1-979d71f96144 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ebd6eade-30b0-467d-8b74-865c52c008bf req-56f2daf5-c90f-4817-95a1-979d71f96144 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ebd6eade-30b0-467d-8b74-865c52c008bf req-56f2daf5-c90f-4817-95a1-979d71f96144 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-ebd6eade-30b0-467d-8b74-865c52c008bf req-56f2daf5-c90f-4817-95a1-979d71f96144 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:30 user nova-compute[72780]: WARNING nova.compute.manager [req-ebd6eade-30b0-467d-8b74-865c52c008bf req-56f2daf5-c90f-4817-95a1-979d71f96144 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state active and task_state resize_finish.
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542935.4424157, 6515b699-7198-4fca-b3f5-30eeb70bf3b1 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:30 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] VM Stopped (Lifecycle Event)
Aug 09 01:02:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-fdac0f3a-e270-4278-9039-669bc0730c79 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542952.2577786, 6515b699-7198-4fca-b3f5-30eeb70bf3b1 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] VM Resumed (Lifecycle Event)
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:02:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance running successfully.
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Failed to set time: agent not configured {{(pid=72780) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ffd2c002-24c9-441f-90f9-9d90df8077b4 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] finish_migration finished successfully. {{(pid=72780) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:02:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691542952.261417, 6515b699-7198-4fca-b3f5-30eeb70bf3b1 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] VM Started (Lifecycle Event)
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-78fd7e8c-04df-4d4a-a625-4112652c3d68 req-0c841414-7c30-456e-b5e1-8b8590c36233 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-78fd7e8c-04df-4d4a-a625-4112652c3d68 req-0c841414-7c30-456e-b5e1-8b8590c36233 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-78fd7e8c-04df-4d4a-a625-4112652c3d68 req-0c841414-7c30-456e-b5e1-8b8590c36233 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-78fd7e8c-04df-4d4a-a625-4112652c3d68 req-0c841414-7c30-456e-b5e1-8b8590c36233 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-78fd7e8c-04df-4d4a-a625-4112652c3d68 req-0c841414-7c30-456e-b5e1-8b8590c36233 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:02:32 user nova-compute[72780]: WARNING nova.compute.manager [req-78fd7e8c-04df-4d4a-a625-4112652c3d68 req-0c841414-7c30-456e-b5e1-8b8590c36233 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state active and task_state resize_finish.
Aug 09 01:02:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 01:02:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:41 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542946.530088, deec36f5-a323-4595-b87a-abc995824040 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:02:41 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: deec36f5-a323-4595-b87a-abc995824040] VM Stopped (Lifecycle Event)
Aug 09 01:02:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-e04480d2-141e-4cf2-a12e-e21d2570fe45 None None] [instance: deec36f5-a323-4595-b87a-abc995824040] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:02:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:02:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:02:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:02:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:02:57 user nova-compute[72780]: INFO nova.compute.claims [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Claim successful on node user
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:02:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:02:58 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:02:58 user nova-compute[72780]: INFO nova.virt.block_device [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Booting with volume-backed-image f43f2d4e-45ef-42ce-9cde-789adcfd9b22 at /dev/vda
Aug 09 01:02:58 user nova-compute[72780]: DEBUG nova.policy [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c93725c6c7e4001b478b1c87d6ba759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d09b1579894f47877a117276c7465f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:02:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:02:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Successfully created port: 4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Successfully updated port: 4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-changed-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Refreshing instance network info cache due to event network-changed-4b08ec95-4889-4a7e-8d14-e849bb924edb. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] Acquiring lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating instance_info_cache with network_info: [{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance network_info: |[{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] Acquired lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:00 user nova-compute[72780]: DEBUG nova.network.neutron [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Refreshing network info cache for port 4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:03:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updated VIF entry in instance network info cache for port 4b08ec95-4889-4a7e-8d14-e849bb924edb. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:03:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating instance_info_cache with network_info: [{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab2e83ea-8799-4f11-a33a-d8f74dd1f249 req-544c222d-1cc1-4462-b5b0-7bed0ab12087 service nova] Releasing lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:03:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:03:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:03:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG os_brick.utils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de63c56-3af8-4df8-9b89-0d0c455e6066]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3ec57-247f-4228-af80-0e6fa210837a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de2251-5f94-4a07-bc29-202fcca22e5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89694d86-aa9a-49f4-b019-91b4ca901a4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78622ce1-353a-4022-9b64-db7ab1692d72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:03:09 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a4782c-53c9-4cd0-8563-5c813c2f8edd]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG os_brick.utils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating existing volume attachment record: 06aa47c7-855c-441b-a81c-6ae00dce9581 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:03:09 user nova-compute[72780]: INFO nova.compute.claims [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Claim successful on node user
Aug 09 01:03:09 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:03:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:03:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:03:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:03:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:03:10 user nova-compute[72780]: DEBUG nova.policy [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54101aceab04126ba338c9965790cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9933f68af5d6419e92195eb3b49687a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:03:10 user nova-compute[72780]: INFO nova.virt.block_device [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Booting with volume snapshot 23013c42-d677-41c6-84d2-477327115a65 at /dev/vda
Aug 09 01:03:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Successfully created port: 88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Successfully updated port: 88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "refresh_cache-78622ce1-353a-4022-9b64-db7ab1692d72" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquired lock "refresh_cache-78622ce1-353a-4022-9b64-db7ab1692d72" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-changed-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Refreshing instance network info cache due to event network-changed-88bde42c-5684-4bd4-a29e-418d7cc7c7b2. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] Acquiring lock "refresh_cache-78622ce1-353a-4022-9b64-db7ab1692d72" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Updating instance_info_cache with network_info: [{"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Releasing lock "refresh_cache-78622ce1-353a-4022-9b64-db7ab1692d72" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Instance network_info: |[{"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] Acquired lock "refresh_cache-78622ce1-353a-4022-9b64-db7ab1692d72" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Refreshing network info cache for port 88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Updated VIF entry in instance network info cache for port 88bde42c-5684-4bd4-a29e-418d7cc7c7b2. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Updating instance_info_cache with network_info: [{"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-963b5dac-b9de-4be3-b676-d7ef221a5311 req-9c2a0505-a2b5-4110-8d0a-382ffe9c8046 service nova] Releasing lock "refresh_cache-78622ce1-353a-4022-9b64-db7ab1692d72" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-changed-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Refreshing instance network info cache due to event network-changed-9441fd0c-536a-494e-83dd-6cba552ca2cb. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] Acquiring lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] Acquired lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Refreshing network info cache for port 9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:12 user nova-compute[72780]: INFO nova.compute.manager [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Terminating instance
Aug 09 01:03:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Updated VIF entry in instance network info cache for port 9441fd0c-536a-494e-83dd-6cba552ca2cb. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Updating instance_info_cache with network_info: [{"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3461b172-2b01-4813-83a8-3391e45b9902 req-00817130-6ec3-43bf-b452-a7e9deab34ef service nova] Releasing lock "refresh_cache-bbe38c09-7b3d-481a-b414-d70a0f89332b" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Instance destroyed successfully.
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'resources' on Instance uuid a35ae1e9-1559-41c8-8476-d571b679c084 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1273789156',display_name='tempest-AttachVolumeNegativeTest-server-1273789156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1273789156',id=17,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBjozkenfdrB2G47pIQhN2BeDQwIVcDbQky1bkOzmiHi3xYOgLdgjJhKjQsUu454W6G20Jki4hqCurD2XPX3stIeqt3/sdQnpftgnnB2DrfX9VDdy6aPVfbgot4CGsK5A==',key_name='tempest-keypair-192565528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:57:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-x9kbx5gi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=a35ae1e9-1559-41c8-8476-d571b679c084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "address": "fa:16:3e:14:84:20", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea508fa-8a", "ovs_interfaceid": "6ea508fa-8a89-4c69-9841-85b4769b06fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG os_vif [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ea508fa-8a, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:13 user nova-compute[72780]: INFO os_vif [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:20,bridge_name='br-int',has_traffic_filtering=True,id=6ea508fa-8a89-4c69-9841-85b4769b06fe,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea508fa-8a')
Aug 09 01:03:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Deleting instance files /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084_del
Aug 09 01:03:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Deletion of /opt/stack/data/nova/instances/a35ae1e9-1559-41c8-8476-d571b679c084_del complete
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-041e1161-afc8-4a1a-b2f5-55465751b07b req-1868dcc1-c9c6-40c6-ae9c-9c1e912a9fe6 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-vif-unplugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-041e1161-afc8-4a1a-b2f5-55465751b07b req-1868dcc1-c9c6-40c6-ae9c-9c1e912a9fe6 service nova] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-041e1161-afc8-4a1a-b2f5-55465751b07b req-1868dcc1-c9c6-40c6-ae9c-9c1e912a9fe6 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-041e1161-afc8-4a1a-b2f5-55465751b07b req-1868dcc1-c9c6-40c6-ae9c-9c1e912a9fe6 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-041e1161-afc8-4a1a-b2f5-55465751b07b req-1868dcc1-c9c6-40c6-ae9c-9c1e912a9fe6 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] No waiting events found dispatching network-vif-unplugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-041e1161-afc8-4a1a-b2f5-55465751b07b req-1868dcc1-c9c6-40c6-ae9c-9c1e912a9fe6 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-vif-unplugged-6ea508fa-8a89-4c69-9841-85b4769b06fe for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:03:13 user nova-compute[72780]: INFO nova.compute.manager [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 01:03:13 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:03:13 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:03:14 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:14 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Took 1.17 seconds to deallocate network for instance.
Aug 09 01:03:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:15 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Deleted allocations for instance a35ae1e9-1559-41c8-8476-d571b679c084
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eb1948f2-0300-41bc-8963-b7c759325b29 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "a35ae1e9-1559-41c8-8476-d571b679c084" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] Acquiring lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] Lock "a35ae1e9-1559-41c8-8476-d571b679c084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] No waiting events found dispatching network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:15 user nova-compute[72780]: WARNING nova.compute.manager [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received unexpected event network-vif-plugged-6ea508fa-8a89-4c69-9841-85b4769b06fe for instance with vm_state deleted and task_state None.
Aug 09 01:03:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-abd8d2e4-8e90-421f-883e-a286f69041a5 req-76608cde-1f46-40ae-b501-b8e2d47b5d80 service nova] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Received event network-vif-deleted-6ea508fa-8a89-4c69-9841-85b4769b06fe {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG os_brick.utils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[34461105-d94e-4b00-86fb-ebbf201baabe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8030019-996a-4ad0-879f-6f2a4a60b526]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61297fe-137f-4e5d-984f-833e23bc6fee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55207b9-94aa-4b0b-8770-4b78fa58d135]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:03:15 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:03:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[700b98f3-285c-4a97-8f42-6fb8f7b22f02]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG os_brick.utils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:15 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Updating existing volume attachment record: b063eb5e-e21a-462d-9051-e53564ab3f75 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:03:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lazy-loading 'flavor' on Instance uuid bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:17 user nova-compute[72780]: INFO nova.compute.manager [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Attaching volume 78ce1e22-956d-441a-b6ef-e00f64c25808 to /dev/vdb
Aug 09 01:03:17 user nova-compute[72780]: DEBUG os_brick.utils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa0b9eb-0d4e-49af-bd28-3606efa964a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac8452-4aec-4b9c-8a65-8e06e759dab9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[44075dee-22f3-445f-be54-26b24368a735]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[269106c2-cd9f-4cb8-8b5f-e745542b87e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:03:17 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:03:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e00d156-97e1-4dbb-ade5-edd9dbd47ebc]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG os_brick.utils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:17 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Updating existing volume attachment record: 6c19dce3-3174-4751-9232-5ac4019e447d {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:03:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Creating image(s)
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Ensure instance console log exists: /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Start _get_guest_xml network_info=[{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '351a0f4e-b337-49ec-8dfb-cde20c1fbc3e', 'attached_at': '', 'detached_at': '', 'volume_id': '50899620-dc05-4248-8f59-068c949cebce', 'serial': '50899620-dc05-4248-8f59-068c949cebce'}, 'disk_bus': 'virtio', 'attachment_id': '06aa47c7-855c-441b-a81c-6ae00dce9581', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:03:18 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:18 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:18 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:18 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:18 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a015b02-8ab5-4644-9e38-df64438f88a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:03:18 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f02c2b-4933-490e-b474-9485bc005869]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce] added
Aug 09 01:03:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00d7d9-94b7-4392-a892-edf35ed4f6a0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b8aa37-2603-4d2a-9502-73d851d42b75]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqSNbBRV {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqSNbBRV" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cc984b-237d-4f2c-9327-f4160b3b5345]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqSNbBRV'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea07ba0-f6e7-4c45-818a-d72a2774e98e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c4c1b8-72fb-4f8e-882f-8ae2f8aee75d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8845f51-9b62-4405-a38d-7ca1178dc20e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260]
Aug 09 01:03:18 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260] successful.
Aug 09 01:03:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496b663-5eec-4688-9045-e585ba560b15]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ee815-0232-4e2d-ba2f-ad5976baf82e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:18 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b196a-ee0f-465b-ace3-be3b8d9f6df0]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:03:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26231313965656539', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231313965656539', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-467904036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-467904036',id=27,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-lv5bkzvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:02:58Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=351a0f4e-b337-49ec-8dfb-cde20c1fbc3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'pci_devices' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:03:19 user nova-compute[72780]:   <uuid>351a0f4e-b337-49ec-8dfb-cde20c1fbc3e</uuid>
Aug 09 01:03:19 user nova-compute[72780]:   <name>instance-0000001b</name>
Aug 09 01:03:19 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:03:19 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:03:19 user nova-compute[72780]:   <metadata>
Aug 09 01:03:19 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:03:19 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:03:19 user nova-compute[72780]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-467904036</nova:name>
Aug 09 01:03:19 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:03:18</nova:creationTime>
Aug 09 01:03:19 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:03:19 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:03:19 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:03:19 user nova-compute[72780]:       <nova:owner>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:user uuid="4c93725c6c7e4001b478b1c87d6ba759">tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member</nova:user>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:project uuid="b3d09b1579894f47877a117276c7465f">tempest-ServerBootFromVolumeStableRescueTest-1823004913</nova:project>
Aug 09 01:03:19 user nova-compute[72780]:       </nova:owner>
Aug 09 01:03:19 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:03:19 user nova-compute[72780]:       <nova:ports>
Aug 09 01:03:19 user nova-compute[72780]:         <nova:port uuid="4b08ec95-4889-4a7e-8d14-e849bb924edb">
Aug 09 01:03:19 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 01:03:19 user nova-compute[72780]:         </nova:port>
Aug 09 01:03:19 user nova-compute[72780]:       </nova:ports>
Aug 09 01:03:19 user nova-compute[72780]:     </nova:instance>
Aug 09 01:03:19 user nova-compute[72780]:   </metadata>
Aug 09 01:03:19 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:03:19 user nova-compute[72780]:     <system>
Aug 09 01:03:19 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:03:19 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:03:19 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:03:19 user nova-compute[72780]:       <entry name="serial">351a0f4e-b337-49ec-8dfb-cde20c1fbc3e</entry>
Aug 09 01:03:19 user nova-compute[72780]:       <entry name="uuid">351a0f4e-b337-49ec-8dfb-cde20c1fbc3e</entry>
Aug 09 01:03:19 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:03:19 user nova-compute[72780]:     </system>
Aug 09 01:03:19 user nova-compute[72780]:   </sysinfo>
Aug 09 01:03:19 user nova-compute[72780]:   <os>
Aug 09 01:03:19 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:03:19 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:03:19 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:03:19 user nova-compute[72780]:   </os>
Aug 09 01:03:19 user nova-compute[72780]:   <features>
Aug 09 01:03:19 user nova-compute[72780]:     <acpi/>
Aug 09 01:03:19 user nova-compute[72780]:     <apic/>
Aug 09 01:03:19 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:03:19 user nova-compute[72780]:   </features>
Aug 09 01:03:19 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:03:19 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:03:19 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:03:19 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:03:19 user nova-compute[72780]:   </clock>
Aug 09 01:03:19 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:03:19 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:03:19 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:03:19 user nova-compute[72780]:   </cpu>
Aug 09 01:03:19 user nova-compute[72780]:   <devices>
Aug 09 01:03:19 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:03:19 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:03:19 user nova-compute[72780]:       <source dev="/dev/sdd"/>
Aug 09 01:03:19 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:03:19 user nova-compute[72780]:       <serial>50899620-dc05-4248-8f59-068c949cebce</serial>
Aug 09 01:03:19 user nova-compute[72780]:     </disk>
Aug 09 01:03:19 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:03:19 user nova-compute[72780]:       <mac address="fa:16:3e:76:05:1e"/>
Aug 09 01:03:19 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:03:19 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:03:19 user nova-compute[72780]:       <target dev="tap4b08ec95-48"/>
Aug 09 01:03:19 user nova-compute[72780]:     </interface>
Aug 09 01:03:19 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:03:19 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/console.log" append="off"/>
Aug 09 01:03:19 user nova-compute[72780]:     </serial>
Aug 09 01:03:19 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:03:19 user nova-compute[72780]:     <video>
Aug 09 01:03:19 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:03:19 user nova-compute[72780]:     </video>
Aug 09 01:03:19 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:03:19 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:03:19 user nova-compute[72780]:     </rng>
Aug 09 01:03:19 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:03:19 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:03:19 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:03:19 user nova-compute[72780]:     </memballoon>
Aug 09 01:03:19 user nova-compute[72780]:   </devices>
Aug 09 01:03:19 user nova-compute[72780]: </domain>
Aug 09 01:03:19 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-467904036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-467904036',id=27,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-lv5bkzvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:02:58Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=351a0f4e-b337-49ec-8dfb-cde20c1fbc3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG os_vif [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b08ec95-48, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b08ec95-48, col_values=(('external_ids', {'iface-id': '4b08ec95-4889-4a7e-8d14-e849bb924edb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:05:1e', 'vm-uuid': '351a0f4e-b337-49ec-8dfb-cde20c1fbc3e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:19 user nova-compute[72780]: INFO os_vif [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48')
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:03:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No VIF found with MAC fa:16:3e:76:05:1e, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:03:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-4631091e-d5f4-43db-b8bd-35d9a79101d1 req-83a07cdc-7c78-4381-9fa1-6a4649b0cf7b service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4631091e-d5f4-43db-b8bd-35d9a79101d1 req-83a07cdc-7c78-4381-9fa1-6a4649b0cf7b service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4631091e-d5f4-43db-b8bd-35d9a79101d1 req-83a07cdc-7c78-4381-9fa1-6a4649b0cf7b service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4631091e-d5f4-43db-b8bd-35d9a79101d1 req-83a07cdc-7c78-4381-9fa1-6a4649b0cf7b service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-4631091e-d5f4-43db-b8bd-35d9a79101d1 req-83a07cdc-7c78-4381-9fa1-6a4649b0cf7b service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:21 user nova-compute[72780]: WARNING nova.compute.manager [req-4631091e-d5f4-43db-b8bd-35d9a79101d1 req-83a07cdc-7c78-4381-9fa1-6a4649b0cf7b service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state building and task_state spawning.
Aug 09 01:03:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543003.2183697, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Resumed (Lifecycle Event)
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance spawned successfully.
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-a02f9088-6e57-47ef-95cd-c92ad842735c req-ceccb29f-da5c-4358-93e2-6c76509e0baa service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a02f9088-6e57-47ef-95cd-c92ad842735c req-ceccb29f-da5c-4358-93e2-6c76509e0baa service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a02f9088-6e57-47ef-95cd-c92ad842735c req-ceccb29f-da5c-4358-93e2-6c76509e0baa service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a02f9088-6e57-47ef-95cd-c92ad842735c req-ceccb29f-da5c-4358-93e2-6c76509e0baa service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-a02f9088-6e57-47ef-95cd-c92ad842735c req-ceccb29f-da5c-4358-93e2-6c76509e0baa service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:23 user nova-compute[72780]: WARNING nova.compute.manager [req-a02f9088-6e57-47ef-95cd-c92ad842735c req-ceccb29f-da5c-4358-93e2-6c76509e0baa service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state building and task_state spawning.
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543003.2189515, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Started (Lifecycle Event)
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:23 user nova-compute[72780]: INFO nova.compute.manager [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Took 25.74 seconds to build instance.
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-236a16c9-45c8-4cea-a48e-b41197642d24 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.888s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7317MB free_disk=25.183242797851562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Applying migration context for instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 as it has an incoming, in-progress migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5. Migration status is finished {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 01:03:24 user nova-compute[72780]: INFO nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating resource usage from migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5
Aug 09 01:03:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9f271642-610f-451a-b6e1-159f2cf3523c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance bbe38c09-7b3d-481a-b414-d70a0f89332b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 8fad1421-722b-4909-8b84-8cc8d69fd865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78622ce1-353a-4022-9b64-db7ab1692d72 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:03:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:03:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Creating image(s)
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Ensure instance console log exists: /opt/stack/data/nova/instances/78622ce1-353a-4022-9b64-db7ab1692d72/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Start _get_guest_xml network_info=[{"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuUSwWoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78622ce1-353a-4022-9b64-db7ab1692d72', 'attached_at': '', 'detached_at': '', 'volume_id': 'a30fe95c-0857-44f5-a3ab-a92648886eaa', 'serial': 'a30fe95c-0857-44f5-a3ab-a92648886eaa'}, 'disk_bus': 'virtio', 'attachment_id': 'b063eb5e-e21a-462d-9051-e53564ab3f75', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:03:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuUSwWoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:25 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:25 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:25 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa54503c-9804-4a18-bccb-bbaf93ece8bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:03:25 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[06916b3e-cc6f-4f16-8446-0b2fb76b921d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa] added
Aug 09 01:03:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c606f42-5e85-4384-83e1-68b181c2c594]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bae397-3ed3-4e20-ad6a-70cc2dcf9062]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuUSwWoT {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuUSwWoT" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[058f8fe7-f7d3-418d-a4bc-a2235c19cc4a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zuUSwWoT'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[119970fd-ad4d-4c16-b1a2-042490c44895]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.405s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da56303-045a-4f35-bf82-c826b63af945]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e0ad7-9672-43a0-a469-81edb9c4a7d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260]
Aug 09 01:03:25 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260] successful.
Aug 09 01:03:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0766f240-d126-4091-b49f-ceb39b189807]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284408c-35e4-41d4-8aad-64df252a5dba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:25 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70d9b3c-4e50-4ea6-8576-60048262f57a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuUSwWoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNgdJDMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:26 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:26 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23539626331616362', 'path': '/dev/sde'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539626331616362', 'path': '/dev/sde'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.602s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:27 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff7d0dd-587c-48d1-8daf-c4cefbbc0689]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:03:27 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-796311580',display_name='tempest-TestVolumeBootPattern-server-796311580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-796311580',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-vxi0z7fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:03:10Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=78622ce1-353a-4022-9b64-db7ab1692d72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'pci_devices' on Instance uuid 78622ce1-353a-4022-9b64-db7ab1692d72 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:03:27 user nova-compute[72780]:   <uuid>78622ce1-353a-4022-9b64-db7ab1692d72</uuid>
Aug 09 01:03:27 user nova-compute[72780]:   <name>instance-0000001c</name>
Aug 09 01:03:27 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:03:27 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:03:27 user nova-compute[72780]:   <metadata>
Aug 09 01:03:27 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:03:27 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:03:27 user nova-compute[72780]:       <nova:name>tempest-TestVolumeBootPattern-server-796311580</nova:name>
Aug 09 01:03:27 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:03:25</nova:creationTime>
Aug 09 01:03:27 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:03:27 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:03:27 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:03:27 user nova-compute[72780]:       <nova:owner>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:user uuid="d54101aceab04126ba338c9965790cf3">tempest-TestVolumeBootPattern-1708118170-project-member</nova:user>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:project uuid="9933f68af5d6419e92195eb3b49687a8">tempest-TestVolumeBootPattern-1708118170</nova:project>
Aug 09 01:03:27 user nova-compute[72780]:       </nova:owner>
Aug 09 01:03:27 user nova-compute[72780]:       <nova:ports>
Aug 09 01:03:27 user nova-compute[72780]:         <nova:port uuid="88bde42c-5684-4bd4-a29e-418d7cc7c7b2">
Aug 09 01:03:27 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 01:03:27 user nova-compute[72780]:         </nova:port>
Aug 09 01:03:27 user nova-compute[72780]:       </nova:ports>
Aug 09 01:03:27 user nova-compute[72780]:     </nova:instance>
Aug 09 01:03:27 user nova-compute[72780]:   </metadata>
Aug 09 01:03:27 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:03:27 user nova-compute[72780]:     <system>
Aug 09 01:03:27 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:03:27 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:03:27 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:03:27 user nova-compute[72780]:       <entry name="serial">78622ce1-353a-4022-9b64-db7ab1692d72</entry>
Aug 09 01:03:27 user nova-compute[72780]:       <entry name="uuid">78622ce1-353a-4022-9b64-db7ab1692d72</entry>
Aug 09 01:03:27 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:03:27 user nova-compute[72780]:     </system>
Aug 09 01:03:27 user nova-compute[72780]:   </sysinfo>
Aug 09 01:03:27 user nova-compute[72780]:   <os>
Aug 09 01:03:27 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:03:27 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:03:27 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:03:27 user nova-compute[72780]:   </os>
Aug 09 01:03:27 user nova-compute[72780]:   <features>
Aug 09 01:03:27 user nova-compute[72780]:     <acpi/>
Aug 09 01:03:27 user nova-compute[72780]:     <apic/>
Aug 09 01:03:27 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:03:27 user nova-compute[72780]:   </features>
Aug 09 01:03:27 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:03:27 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:03:27 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:03:27 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:03:27 user nova-compute[72780]:   </clock>
Aug 09 01:03:27 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:03:27 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:03:27 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:03:27 user nova-compute[72780]:   </cpu>
Aug 09 01:03:27 user nova-compute[72780]:   <devices>
Aug 09 01:03:27 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:03:27 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:03:27 user nova-compute[72780]:       <source dev="/dev/sde"/>
Aug 09 01:03:27 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:03:27 user nova-compute[72780]:       <serial>a30fe95c-0857-44f5-a3ab-a92648886eaa</serial>
Aug 09 01:03:27 user nova-compute[72780]:     </disk>
Aug 09 01:03:27 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:03:27 user nova-compute[72780]:       <mac address="fa:16:3e:7b:82:84"/>
Aug 09 01:03:27 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:03:27 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:03:27 user nova-compute[72780]:       <target dev="tap88bde42c-56"/>
Aug 09 01:03:27 user nova-compute[72780]:     </interface>
Aug 09 01:03:27 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:03:27 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/78622ce1-353a-4022-9b64-db7ab1692d72/console.log" append="off"/>
Aug 09 01:03:27 user nova-compute[72780]:     </serial>
Aug 09 01:03:27 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:03:27 user nova-compute[72780]:     <video>
Aug 09 01:03:27 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:03:27 user nova-compute[72780]:     </video>
Aug 09 01:03:27 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:03:27 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:03:27 user nova-compute[72780]:     </rng>
Aug 09 01:03:27 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:03:27 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:03:27 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:03:27 user nova-compute[72780]:     </memballoon>
Aug 09 01:03:27 user nova-compute[72780]:   </devices>
Aug 09 01:03:27 user nova-compute[72780]: </domain>
Aug 09 01:03:27 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-796311580',display_name='tempest-TestVolumeBootPattern-server-796311580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-796311580',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-vxi0z7fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:03:10Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=78622ce1-353a-4022-9b64-db7ab1692d72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_vif [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d83025e-ef30-4b9d-b164-ed380c386670]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808] added
Aug 09 01:03:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88bde42c-56, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88bde42c-56, col_values=(('external_ids', {'iface-id': '88bde42c-5684-4bd4-a29e-418d7cc7c7b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:82:84', 'vm-uuid': '78622ce1-353a-4022-9b64-db7ab1692d72'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: INFO os_vif [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56')
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcd36ce-7b4c-43bf-b82e-62f2709b4391]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[91496a71-23cc-4864-b638-6e33b1c0befa]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNgdJDMl {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No VIF found with MAC fa:16:3e:7b:82:84, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNgdJDMl" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba4630-3475-4818-9fa7-82d5839ac3b2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNgdJDMl'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[85947319-9fb9-423e-819f-51007cec7647]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c4b301-c249-4058-b113-42261cd9139c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd0202-1788-4fa3-83cf-1ef1cdb6c675]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260]
Aug 09 01:03:27 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260] successful.
Aug 09 01:03:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c01b877-bc73-415b-8289-0555dabb1bfc]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2092cb53-42d2-4aa4-adee-5f19bb22cd44]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:27 user nova-compute[72780]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)
Aug 09 01:03:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4a7b1-c063-413e-94de-7faba1dc8b1c]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNgdJDMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:27 user nova-compute[72780]: INFO nova.compute.manager [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Terminating instance
Aug 09 01:03:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-82d08945-6c52-4a6b-9838-b32fe6017b30 req-9ce14936-2952-4b33-acf1-b4a1ea1f678b service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-82d08945-6c52-4a6b-9838-b32fe6017b30 req-9ce14936-2952-4b33-acf1-b4a1ea1f678b service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-82d08945-6c52-4a6b-9838-b32fe6017b30 req-9ce14936-2952-4b33-acf1-b4a1ea1f678b service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-82d08945-6c52-4a6b-9838-b32fe6017b30 req-9ce14936-2952-4b33-acf1-b4a1ea1f678b service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-82d08945-6c52-4a6b-9838-b32fe6017b30 req-9ce14936-2952-4b33-acf1-b4a1ea1f678b service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-82d08945-6c52-4a6b-9838-b32fe6017b30 req-9ce14936-2952-4b33-acf1-b4a1ea1f678b service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-unplugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] <== connect_volume: return (1979ms) {'type': 'block', 'scsi_wwn': '23831653262336664', 'path': '/dev/sdf'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831653262336664', 'path': '/dev/sdf'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lazy-loading 'flavor' on Instance uuid bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691542993.4473872, a35ae1e9-1559-41c8-8476-d571b679c084 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:28 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] VM Stopped (Lifecycle Event)
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:03:28 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:03:28 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:03:28 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:03:28 user nova-compute[72780]:   <serial>78ce1e22-956d-441a-b6ef-e00f64c25808</serial>
Aug 09 01:03:28 user nova-compute[72780]: </disk>
Aug 09 01:03:28 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-65d807d2-c0c4-4c15-bcf2-1e0ad0c25a69 None None] [instance: a35ae1e9-1559-41c8-8476-d571b679c084] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Instance destroyed successfully.
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lazy-loading 'resources' on Instance uuid 9f271642-610f-451a-b6e1-159f2cf3523c {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1122386235',display_name='tempest-ServerActionsTestOtherB-server-1122386235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1122386235',id=13,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1Pp0CJjoikhYjlz3jdoXqO+yAZD7klqJ71giIsNbxPu9rWnbYcw/F3dIG9onJPR6cSC40f160RPy05MTCBKkk7vJuhQaZkXuyaXsnvtajSmON8KhLWVG9lTOURsxnkQ==',key_name='tempest-keypair-1886380241',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4b5ecdb327a4ee98887cd048c08ca0d',ramdisk_id='',reservation_id='r-udax8745',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-897270837',owner_user_name='tempest-ServerActionsTestOtherB-897270837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:00:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70e71720a3524b229f3c2c7a327db2c8',uuid=9f271642-610f-451a-b6e1-159f2cf3523c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converting VIF {"id": "43628f21-b02e-42b7-9469-004c6be8b75a", "address": "fa:16:3e:3a:22:77", "network": {"id": "c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-174260641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4b5ecdb327a4ee98887cd048c08ca0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43628f21-b0", "ovs_interfaceid": "43628f21-b02e-42b7-9469-004c6be8b75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_vif [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43628f21-b0, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:28 user nova-compute[72780]: INFO os_vif [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:77,bridge_name='br-int',has_traffic_filtering=True,id=43628f21-b02e-42b7-9469-004c6be8b75a,network=Network(c9b661ff-dfc3-4fe7-a8f9-ce9af0f7d409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43628f21-b0')
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'clmeZgnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:28 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dd04bc-df68-44eb-824e-35a0dcdc79a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] No VIF found with MAC fa:16:3e:93:2e:fe, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[689cb0f2-55d8-4e88-8aa6-a9b95b15f5d1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)
Aug 09 01:03:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:28 user nova-compute[72780]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)
Aug 09 01:03:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac043c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:03:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb3000-95c6-474e-975e-2d38fb8faaa1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346b428-9564-486a-b71d-34c5f02a1ab1]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[67911ff4-75d1-4eee-92f1-873f7deae224]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965008a-69c3-46e2-891d-17e7626d0713]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da12ee3-4849-4153-a13f-d7d15d38dae6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a8dc967c-d428-44bc-8cc1-615d36229a60 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.152s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24256b8-a3f9-4808-be5a-50f7befa300b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260]
Aug 09 01:03:29 user nova-compute[72780]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095, portal: 172.16.0.220,3260] successful.
Aug 09 01:03:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9917b1-e23b-43f1-ae97-02dba67e4095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba78f424-5e99-48ac-9db6-fb2082fe4cbd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] <== disconnect_volume: return (367ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:03:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Deleting instance files /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c_del
Aug 09 01:03:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Deletion of /opt/stack/data/nova/instances/9f271642-610f-451a-b6e1-159f2cf3523c_del complete
Aug 09 01:03:29 user nova-compute[72780]: INFO nova.compute.manager [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Took 1.70 seconds to destroy the instance on the hypervisor.
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7675718-bfac-488e-9a46-b0fc4743c067 req-0ac2a0fe-1991-4bae-954d-99d2b70fb031 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7675718-bfac-488e-9a46-b0fc4743c067 req-0ac2a0fe-1991-4bae-954d-99d2b70fb031 service nova] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7675718-bfac-488e-9a46-b0fc4743c067 req-0ac2a0fe-1991-4bae-954d-99d2b70fb031 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7675718-bfac-488e-9a46-b0fc4743c067 req-0ac2a0fe-1991-4bae-954d-99d2b70fb031 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7675718-bfac-488e-9a46-b0fc4743c067 req-0ac2a0fe-1991-4bae-954d-99d2b70fb031 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] No waiting events found dispatching network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:29 user nova-compute[72780]: WARNING nova.compute.manager [req-c7675718-bfac-488e-9a46-b0fc4743c067 req-0ac2a0fe-1991-4bae-954d-99d2b70fb031 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received unexpected event network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 for instance with vm_state building and task_state spawning.
Aug 09 01:03:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-c11df481-39e0-46be-b4c5-a7b7e53e1b4e req-8a63be22-19d4-44f9-8813-dc97913f6c1e service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c11df481-39e0-46be-b4c5-a7b7e53e1b4e req-8a63be22-19d4-44f9-8813-dc97913f6c1e service nova] Acquiring lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c11df481-39e0-46be-b4c5-a7b7e53e1b4e req-8a63be22-19d4-44f9-8813-dc97913f6c1e service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c11df481-39e0-46be-b4c5-a7b7e53e1b4e req-8a63be22-19d4-44f9-8813-dc97913f6c1e service nova] Lock "9f271642-610f-451a-b6e1-159f2cf3523c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-c11df481-39e0-46be-b4c5-a7b7e53e1b4e req-8a63be22-19d4-44f9-8813-dc97913f6c1e service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] No waiting events found dispatching network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:30 user nova-compute[72780]: WARNING nova.compute.manager [req-c11df481-39e0-46be-b4c5-a7b7e53e1b4e req-8a63be22-19d4-44f9-8813-dc97913f6c1e service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received unexpected event network-vif-plugged-43628f21-b02e-42b7-9469-004c6be8b75a for instance with vm_state active and task_state deleting.
Aug 09 01:03:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:30 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:30 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Took 1.38 seconds to deallocate network for instance.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543011.4407313, 78622ce1-353a-4022-9b64-db7ab1692d72 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] VM Resumed (Lifecycle Event)
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Instance spawned successfully.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] No waiting events found dispatching network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:31 user nova-compute[72780]: WARNING nova.compute.manager [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received unexpected event network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 for instance with vm_state building and task_state spawning.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-efa02545-eed3-477c-8a80-480099ba1b42 req-416caa42-8120-4d69-acb3-b9f7e8a05027 service nova] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Received event network-vif-deleted-43628f21-b02e-42b7-9469-004c6be8b75a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543011.4416642, 78622ce1-353a-4022-9b64-db7ab1692d72 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] VM Started (Lifecycle Event)
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Detaching volume 78ce1e22-956d-441a-b6ef-e00f64c25808
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.virt.block_device [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Attempting to driver detach volume 78ce1e22-956d-441a-b6ef-e00f64c25808 from mountpoint /dev/vdb
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Attempting to detach device vdb from instance bbe38c09-7b3d-481a-b414-d70a0f89332b from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:03:31 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:03:31 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:03:31 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:03:31 user nova-compute[72780]:   <serial>78ce1e22-956d-441a-b6ef-e00f64c25808</serial>
Aug 09 01:03:31 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:03:31 user nova-compute[72780]: </disk>
Aug 09 01:03:31 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Successfully detached device vdb from instance bbe38c09-7b3d-481a-b414-d70a0f89332b from the persistent domain config.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbe38c09-7b3d-481a-b414-d70a0f89332b from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:03:31 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:03:31 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:03:31 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:03:31 user nova-compute[72780]:   <serial>78ce1e22-956d-441a-b6ef-e00f64c25808</serial>
Aug 09 01:03:31 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:03:31 user nova-compute[72780]: </disk>
Aug 09 01:03:31 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Took 1.04 seconds to detach 1 volumes for instance.
Aug 09 01:03:31 user nova-compute[72780]: INFO nova.compute.manager [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Took 22.42 seconds to build instance.
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83d97a85-389a-4c2f-85c9-4616bff77434 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78622ce1-353a-4022-9b64-db7ab1692d72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.521s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543012.1959236, bbe38c09-7b3d-481a-b414-d70a0f89332b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:03:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Successfully detached device vdb from instance bbe38c09-7b3d-481a-b414-d70a0f89332b from the live domain config.
Aug 09 01:03:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNgdJDMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:03:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07419b8-f32a-4efb-b777-09e60266abf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10315c5d-6118-466e-98f9-91fb18d28e81]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)
Aug 09 01:03:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:03:32 user nova-compute[72780]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 (non-flash)
Aug 09 01:03:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ad8234790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808'): ({'sdf'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Removing single pathed devices sdf {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c361b-3bd8-4412-a6ad-1714b291df5d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7210a7b9-326c-49b8-9dd4-12f83b1fe63c]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Flushing IO for device /dev/sdf {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c9a009-10be-4e8f-8fdc-edaf54581b8e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aedd3ea-aabc-4275-9286-2085e821d2e8]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Deleted allocations for instance 9f271642-610f-451a-b6e1-159f2cf3523c
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[21171ac3-583c-49c0-9637-9de338c82b20]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934575a-e676-4aad-a07d-418b16fb5d14]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260]
Aug 09 01:03:32 user nova-compute[72780]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808, portal: 172.16.0.220,3260] successful.
Aug 09 01:03:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-97fcfbe1-0b5f-4123-a3f0-a6e29737021c tempest-ServerActionsTestOtherB-897270837 tempest-ServerActionsTestOtherB-897270837-project-member] Lock "9f271642-610f-451a-b6e1-159f2cf3523c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.888s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce1e22-956d-441a-b6ef-e00f64c25808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b581a686-f753-46ad-96eb-6e07dc692d96]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] <== disconnect_volume: return (367ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:03:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:03:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lazy-loading 'flavor' on Instance uuid bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ee3f139-4ba3-4e37-bc30-29be79fd7cda tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.899s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:03:35 user nova-compute[72780]: INFO nova.compute.claims [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Claim successful on node user
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:03:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.policy [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c08a00919854aaf9f20c0b66c54eb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc20d829ea406fa62810d68d336ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:03:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Creating image(s)
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "/opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "/opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "/opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk 1073741824" returned: 0 in 0.052s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.172s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Cannot resize image /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lazy-loading 'migration_context' on Instance uuid e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Ensure instance console log exists: /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Successfully created port: bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Successfully updated port: bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-changed-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Refreshing instance network info cache due to event network-changed-bc501bed-1290-4db9-832b-1c122d9d2db0. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] Acquiring lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] Acquired lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG nova.network.neutron [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Refreshing network info cache for port bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:03:37 user nova-compute[72780]: DEBUG nova.network.neutron [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.neutron [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6c16557-7944-4e43-bfbb-241de50badd3 req-8ae177ce-60a0-4ed4-9ec3-83bbc0dd229d service nova] Releasing lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquired lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updating instance_info_cache with network_info: [{"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Releasing lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Instance network_info: |[{"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Start _get_guest_xml network_info=[{"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:03:38 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:38 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-267123619',display_name='tempest-ServersNegativeTestJSON-server-267123619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-267123619',id=29,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bdc20d829ea406fa62810d68d336ee9',ramdisk_id='',reservation_id='r-k6qlf7ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030464829',owner_user_name='tempest-ServersNegativeTestJSON-1030464829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:03:36Z,user_data=None,user_id='3c08a00919854aaf9f20c0b66c54eb21',uuid=e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converting VIF {"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lazy-loading 'pci_devices' on Instance uuid e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:03:38 user nova-compute[72780]:   <uuid>e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb</uuid>
Aug 09 01:03:38 user nova-compute[72780]:   <name>instance-0000001d</name>
Aug 09 01:03:38 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:03:38 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:03:38 user nova-compute[72780]:   <metadata>
Aug 09 01:03:38 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:03:38 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:03:38 user nova-compute[72780]:       <nova:name>tempest-ServersNegativeTestJSON-server-267123619</nova:name>
Aug 09 01:03:38 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:03:38</nova:creationTime>
Aug 09 01:03:38 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:03:38 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:03:38 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:03:38 user nova-compute[72780]:       <nova:owner>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:user uuid="3c08a00919854aaf9f20c0b66c54eb21">tempest-ServersNegativeTestJSON-1030464829-project-member</nova:user>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:project uuid="0bdc20d829ea406fa62810d68d336ee9">tempest-ServersNegativeTestJSON-1030464829</nova:project>
Aug 09 01:03:38 user nova-compute[72780]:       </nova:owner>
Aug 09 01:03:38 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:03:38 user nova-compute[72780]:       <nova:ports>
Aug 09 01:03:38 user nova-compute[72780]:         <nova:port uuid="bc501bed-1290-4db9-832b-1c122d9d2db0">
Aug 09 01:03:38 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:03:38 user nova-compute[72780]:         </nova:port>
Aug 09 01:03:38 user nova-compute[72780]:       </nova:ports>
Aug 09 01:03:38 user nova-compute[72780]:     </nova:instance>
Aug 09 01:03:38 user nova-compute[72780]:   </metadata>
Aug 09 01:03:38 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:03:38 user nova-compute[72780]:     <system>
Aug 09 01:03:38 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:03:38 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:03:38 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:03:38 user nova-compute[72780]:       <entry name="serial">e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb</entry>
Aug 09 01:03:38 user nova-compute[72780]:       <entry name="uuid">e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb</entry>
Aug 09 01:03:38 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:03:38 user nova-compute[72780]:     </system>
Aug 09 01:03:38 user nova-compute[72780]:   </sysinfo>
Aug 09 01:03:38 user nova-compute[72780]:   <os>
Aug 09 01:03:38 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:03:38 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:03:38 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:03:38 user nova-compute[72780]:   </os>
Aug 09 01:03:38 user nova-compute[72780]:   <features>
Aug 09 01:03:38 user nova-compute[72780]:     <acpi/>
Aug 09 01:03:38 user nova-compute[72780]:     <apic/>
Aug 09 01:03:38 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:03:38 user nova-compute[72780]:   </features>
Aug 09 01:03:38 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:03:38 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:03:38 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:03:38 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:03:38 user nova-compute[72780]:   </clock>
Aug 09 01:03:38 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:03:38 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:03:38 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:03:38 user nova-compute[72780]:   </cpu>
Aug 09 01:03:38 user nova-compute[72780]:   <devices>
Aug 09 01:03:38 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:03:38 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:03:38 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk"/>
Aug 09 01:03:38 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:03:38 user nova-compute[72780]:     </disk>
Aug 09 01:03:38 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:03:38 user nova-compute[72780]:       <mac address="fa:16:3e:e5:22:d6"/>
Aug 09 01:03:38 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:03:38 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:03:38 user nova-compute[72780]:       <target dev="tapbc501bed-12"/>
Aug 09 01:03:38 user nova-compute[72780]:     </interface>
Aug 09 01:03:38 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:03:38 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/console.log" append="off"/>
Aug 09 01:03:38 user nova-compute[72780]:     </serial>
Aug 09 01:03:38 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:03:38 user nova-compute[72780]:     <video>
Aug 09 01:03:38 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:03:38 user nova-compute[72780]:     </video>
Aug 09 01:03:38 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:03:38 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:03:38 user nova-compute[72780]:     </rng>
Aug 09 01:03:38 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:03:38 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:03:38 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:03:38 user nova-compute[72780]:     </memballoon>
Aug 09 01:03:38 user nova-compute[72780]:   </devices>
Aug 09 01:03:38 user nova-compute[72780]: </domain>
Aug 09 01:03:38 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-267123619',display_name='tempest-ServersNegativeTestJSON-server-267123619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-267123619',id=29,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bdc20d829ea406fa62810d68d336ee9',ramdisk_id='',reservation_id='r-k6qlf7ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030464829',owner_user_name='tempest-ServersNegativeTestJSON-1030464829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:03:36Z,user_data=None,user_id='3c08a00919854aaf9f20c0b66c54eb21',uuid=e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converting VIF {"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG os_vif [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc501bed-12, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc501bed-12, col_values=(('external_ids', {'iface-id': 'bc501bed-1290-4db9-832b-1c122d9d2db0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:22:d6', 'vm-uuid': 'e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:38 user nova-compute[72780]: INFO os_vif [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12')
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:03:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] No VIF found with MAC fa:16:3e:e5:22:d6, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:03:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-25c9710e-d7f5-4284-b3e9-a84ee5c80b29 req-0d66d55e-940d-49fa-b77d-61978eaa4b0c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-25c9710e-d7f5-4284-b3e9-a84ee5c80b29 req-0d66d55e-940d-49fa-b77d-61978eaa4b0c service nova] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-25c9710e-d7f5-4284-b3e9-a84ee5c80b29 req-0d66d55e-940d-49fa-b77d-61978eaa4b0c service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-25c9710e-d7f5-4284-b3e9-a84ee5c80b29 req-0d66d55e-940d-49fa-b77d-61978eaa4b0c service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-25c9710e-d7f5-4284-b3e9-a84ee5c80b29 req-0d66d55e-940d-49fa-b77d-61978eaa4b0c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] No waiting events found dispatching network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:40 user nova-compute[72780]: WARNING nova.compute.manager [req-25c9710e-d7f5-4284-b3e9-a84ee5c80b29 req-0d66d55e-940d-49fa-b77d-61978eaa4b0c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received unexpected event network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 for instance with vm_state building and task_state spawning.
Aug 09 01:03:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543022.1805687, e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] VM Resumed (Lifecycle Event)
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Instance spawned successfully.
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543022.1864173, e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] VM Started (Lifecycle Event)
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-861b02c7-4964-4bee-a1b2-e19d2f40b0d3 req-bc482e36-2d93-4a9d-918f-d4e848876ea0 service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-861b02c7-4964-4bee-a1b2-e19d2f40b0d3 req-bc482e36-2d93-4a9d-918f-d4e848876ea0 service nova] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-861b02c7-4964-4bee-a1b2-e19d2f40b0d3 req-bc482e36-2d93-4a9d-918f-d4e848876ea0 service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-861b02c7-4964-4bee-a1b2-e19d2f40b0d3 req-bc482e36-2d93-4a9d-918f-d4e848876ea0 service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-861b02c7-4964-4bee-a1b2-e19d2f40b0d3 req-bc482e36-2d93-4a9d-918f-d4e848876ea0 service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] No waiting events found dispatching network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:42 user nova-compute[72780]: WARNING nova.compute.manager [req-861b02c7-4964-4bee-a1b2-e19d2f40b0d3 req-bc482e36-2d93-4a9d-918f-d4e848876ea0 service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received unexpected event network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 for instance with vm_state building and task_state spawning.
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 09 01:03:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:42 user nova-compute[72780]: INFO nova.compute.manager [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Took 7.39 seconds to build instance.
Aug 09 01:03:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a28536a1-afa6-492b-bd92-c29067828d86 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.482s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:43 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543008.8404827, 9f271642-610f-451a-b6e1-159f2cf3523c => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:03:43 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] VM Stopped (Lifecycle Event)
Aug 09 01:03:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-03cdf93a-594e-4500-9041-00ec6a016a61 None None] [instance: 9f271642-610f-451a-b6e1-159f2cf3523c] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:03:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:51 user nova-compute[72780]: INFO nova.compute.manager [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Terminating instance
Aug 09 01:03:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f25b9550-75a7-4925-bf26-a5109ce16f3e req-74c292d1-5bfe-46f0-8f67-cb09459d81b6 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-unplugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f25b9550-75a7-4925-bf26-a5109ce16f3e req-74c292d1-5bfe-46f0-8f67-cb09459d81b6 service nova] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f25b9550-75a7-4925-bf26-a5109ce16f3e req-74c292d1-5bfe-46f0-8f67-cb09459d81b6 service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f25b9550-75a7-4925-bf26-a5109ce16f3e req-74c292d1-5bfe-46f0-8f67-cb09459d81b6 service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f25b9550-75a7-4925-bf26-a5109ce16f3e req-74c292d1-5bfe-46f0-8f67-cb09459d81b6 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] No waiting events found dispatching network-vif-unplugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-f25b9550-75a7-4925-bf26-a5109ce16f3e req-74c292d1-5bfe-46f0-8f67-cb09459d81b6 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-unplugged-6d6d402d-7bf9-466c-babe-15a812b7f23a for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Instance destroyed successfully.
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lazy-loading 'resources' on Instance uuid 8fad1421-722b-4909-8b84-8cc8d69fd865 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1871234648',display_name='tempest-VolumesActionsTest-instance-1871234648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1871234648',id=25,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:02:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2f203320294ed59055d5d0d3cf322a',ramdisk_id='',reservation_id='r-ta4vkyoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1675369655',owner_user_name='tempest-VolumesActionsTest-1675369655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:02:07Z,user_data=None,user_id='da43fc200f6044668eec95f723ec2486',uuid=8fad1421-722b-4909-8b84-8cc8d69fd865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converting VIF {"id": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "address": "fa:16:3e:f7:b5:44", "network": {"id": "850800f4-1a06-45cd-9525-188e03f2f49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1938983857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2f203320294ed59055d5d0d3cf322a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d402d-7b", "ovs_interfaceid": "6d6d402d-7bf9-466c-babe-15a812b7f23a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG os_vif [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d6d402d-7b, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:03:52 user nova-compute[72780]: INFO os_vif [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:44,bridge_name='br-int',has_traffic_filtering=True,id=6d6d402d-7bf9-466c-babe-15a812b7f23a,network=Network(850800f4-1a06-45cd-9525-188e03f2f49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d402d-7b')
Aug 09 01:03:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Deleting instance files /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865_del
Aug 09 01:03:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Deletion of /opt/stack/data/nova/instances/8fad1421-722b-4909-8b84-8cc8d69fd865_del complete
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: INFO nova.compute.manager [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 01:03:52 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Took 0.62 seconds to deallocate network for instance.
Aug 09 01:03:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-52cf5a45-ddd4-49cf-a04a-889049fb4eff req-7a0926c8-7036-4826-a8ac-c0a7f9a98b18 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-deleted-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:53 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Deleted allocations for instance 8fad1421-722b-4909-8b84-8cc8d69fd865
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ba2cb727-a4d1-41a9-901a-9015501fade1 tempest-VolumesActionsTest-1675369655 tempest-VolumesActionsTest-1675369655-project-member] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] No waiting events found dispatching network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:53 user nova-compute[72780]: WARNING nova.compute.manager [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received unexpected event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a for instance with vm_state deleted and task_state None.
Aug 09 01:03:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] Acquiring lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] Lock "8fad1421-722b-4909-8b84-8cc8d69fd865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:03:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] No waiting events found dispatching network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:03:53 user nova-compute[72780]: WARNING nova.compute.manager [req-e679f013-d089-4c74-8b77-fad140760527 req-182a169f-a01e-476b-820b-81fcae93d823 service nova] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Received unexpected event network-vif-plugged-6d6d402d-7bf9-466c-babe-15a812b7f23a for instance with vm_state deleted and task_state None.
Aug 09 01:03:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:03:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-changed-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Refreshing instance network info cache due to event network-changed-9995e7c0-cfda-4997-9c7e-0df5fb8b751b. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] Acquiring lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] Acquired lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Refreshing network info cache for port 9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Going to confirm migration 2 {{(pid=72780) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquired lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.objects.instance [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'info_cache' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updated VIF entry in instance network info cache for port 9995e7c0-cfda-4997-9c7e-0df5fb8b751b. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:04:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updating instance_info_cache with network_info: [{"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e79e0615-7c29-4f8a-9eec-da1f86da1492 req-ce812437-1d12-4700-b160-ee1da1259e3a service nova] Releasing lock "refresh_cache-318b5ce7-b2af-4d57-a158-070713c3ebc7" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [{"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Releasing lock "refresh_cache-6515b699-7198-4fca-b3f5-30eeb70bf3b1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG nova.objects.instance [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'migration_context' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:04:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.408s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:04 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Deleted allocation for migration a8ba322c-57b8-42ba-aa4c-d565ff9d17a5
Aug 09 01:04:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-590e7f1c-114a-44ea-adb6-e623302b4ad1 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.552s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:06 user nova-compute[72780]: INFO nova.compute.manager [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attaching volume af577c11-92bb-4da9-9013-0b8970554e31 to /dev/vdb
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:04:06 user nova-compute[72780]: INFO nova.compute.claims [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Claim successful on node user
Aug 09 01:04:06 user nova-compute[72780]: DEBUG os_brick.utils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e77ae5-fd07-4618-9bfa-8d21b41b93b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b6c600-f61f-4885-b0d7-245f3bab4217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4152f07-46e0-4dde-b414-480b7fab6f65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e035d41-8957-4c39-b655-a008aeac5c66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:04:06 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f89521-c3d5-4acd-a6ef-ea265459863b]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG os_brick.utils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updating existing volume attachment record: 0d4a6d35-89de-4ed6-b3cd-6f2ae4c67c9e {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:04:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:04:06 user nova-compute[72780]: DEBUG nova.policy [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0456a39aaa64bdca5df6a3b67ea9d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0bd68653554fafa823eacae86e21a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:04:07 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Creating image(s)
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "/opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543032.1972022, 8fad1421-722b-4909-8b84-8cc8d69fd865 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:07 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] VM Stopped (Lifecycle Event)
Aug 09 01:04:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-36161fcb-811b-463e-b23c-c25d23c20a82 None None] [instance: 8fad1421-722b-4909-8b84-8cc8d69fd865] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk 1073741824" returned: 0 in 0.050s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Cannot resize image /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'migration_context' on Instance uuid 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Successfully created port: 38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Ensure instance console log exists: /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Successfully updated port: 38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquired lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-changed-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Refreshing instance network info cache due to event network-changed-38ba6593-b72d-4c53-8710-378da9c4c8f6. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] Acquiring lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updating instance_info_cache with network_info: [{"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Releasing lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Instance network_info: |[{"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] Acquired lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.neutron [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Refreshing network info cache for port 38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Start _get_guest_xml network_info=[{"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:04:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:08 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1140885323',display_name='tempest-AttachVolumeNegativeTest-server-1140885323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1140885323',id=30,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg23n/fYzeI1WYIY0ZxL0HweB9vc0HtWW8TZJTcEnbeDVN0AZTEz0oBZaebBR5oAo6bHJezYLULBXLiG6u+2SJR2Yv8FANAk1NY7QxeUDrblLfagow1fKgdggAOX7/jiA==',key_name='tempest-keypair-1347369617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-9ujexpou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=3816591d-6b75-4813-8651-e012289c6a41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'pci_devices' on Instance uuid 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:04:08 user nova-compute[72780]:   <uuid>3816591d-6b75-4813-8651-e012289c6a41</uuid>
Aug 09 01:04:08 user nova-compute[72780]:   <name>instance-0000001e</name>
Aug 09 01:04:08 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:04:08 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:04:08 user nova-compute[72780]:   <metadata>
Aug 09 01:04:08 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:04:08 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:04:08 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1140885323</nova:name>
Aug 09 01:04:08 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:04:08</nova:creationTime>
Aug 09 01:04:08 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:04:08 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:04:08 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:04:08 user nova-compute[72780]:       <nova:owner>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:user uuid="f0456a39aaa64bdca5df6a3b67ea9d68">tempest-AttachVolumeNegativeTest-1434038909-project-member</nova:user>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:project uuid="dd0bd68653554fafa823eacae86e21a0">tempest-AttachVolumeNegativeTest-1434038909</nova:project>
Aug 09 01:04:08 user nova-compute[72780]:       </nova:owner>
Aug 09 01:04:08 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:04:08 user nova-compute[72780]:       <nova:ports>
Aug 09 01:04:08 user nova-compute[72780]:         <nova:port uuid="38ba6593-b72d-4c53-8710-378da9c4c8f6">
Aug 09 01:04:08 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 01:04:08 user nova-compute[72780]:         </nova:port>
Aug 09 01:04:08 user nova-compute[72780]:       </nova:ports>
Aug 09 01:04:08 user nova-compute[72780]:     </nova:instance>
Aug 09 01:04:08 user nova-compute[72780]:   </metadata>
Aug 09 01:04:08 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:04:08 user nova-compute[72780]:     <system>
Aug 09 01:04:08 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:04:08 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:04:08 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:04:08 user nova-compute[72780]:       <entry name="serial">3816591d-6b75-4813-8651-e012289c6a41</entry>
Aug 09 01:04:08 user nova-compute[72780]:       <entry name="uuid">3816591d-6b75-4813-8651-e012289c6a41</entry>
Aug 09 01:04:08 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:04:08 user nova-compute[72780]:     </system>
Aug 09 01:04:08 user nova-compute[72780]:   </sysinfo>
Aug 09 01:04:08 user nova-compute[72780]:   <os>
Aug 09 01:04:08 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:04:08 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:04:08 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:04:08 user nova-compute[72780]:   </os>
Aug 09 01:04:08 user nova-compute[72780]:   <features>
Aug 09 01:04:08 user nova-compute[72780]:     <acpi/>
Aug 09 01:04:08 user nova-compute[72780]:     <apic/>
Aug 09 01:04:08 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:04:08 user nova-compute[72780]:   </features>
Aug 09 01:04:08 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:04:08 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:04:08 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:04:08 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:04:08 user nova-compute[72780]:   </clock>
Aug 09 01:04:08 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:04:08 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:04:08 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:04:08 user nova-compute[72780]:   </cpu>
Aug 09 01:04:08 user nova-compute[72780]:   <devices>
Aug 09 01:04:08 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:04:08 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:04:08 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk"/>
Aug 09 01:04:08 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:04:08 user nova-compute[72780]:     </disk>
Aug 09 01:04:08 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:04:08 user nova-compute[72780]:       <mac address="fa:16:3e:14:01:cd"/>
Aug 09 01:04:08 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:04:08 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:04:08 user nova-compute[72780]:       <target dev="tap38ba6593-b7"/>
Aug 09 01:04:08 user nova-compute[72780]:     </interface>
Aug 09 01:04:08 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:04:08 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/console.log" append="off"/>
Aug 09 01:04:08 user nova-compute[72780]:     </serial>
Aug 09 01:04:08 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:04:08 user nova-compute[72780]:     <video>
Aug 09 01:04:08 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:04:08 user nova-compute[72780]:     </video>
Aug 09 01:04:08 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:04:08 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:04:08 user nova-compute[72780]:     </rng>
Aug 09 01:04:08 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:04:08 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:04:08 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:04:08 user nova-compute[72780]:     </memballoon>
Aug 09 01:04:08 user nova-compute[72780]:   </devices>
Aug 09 01:04:08 user nova-compute[72780]: </domain>
Aug 09 01:04:08 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1140885323',display_name='tempest-AttachVolumeNegativeTest-server-1140885323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1140885323',id=30,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg23n/fYzeI1WYIY0ZxL0HweB9vc0HtWW8TZJTcEnbeDVN0AZTEz0oBZaebBR5oAo6bHJezYLULBXLiG6u+2SJR2Yv8FANAk1NY7QxeUDrblLfagow1fKgdggAOX7/jiA==',key_name='tempest-keypair-1347369617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-9ujexpou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=3816591d-6b75-4813-8651-e012289c6a41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG os_vif [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38ba6593-b7, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38ba6593-b7, col_values=(('external_ids', {'iface-id': '38ba6593-b72d-4c53-8710-378da9c4c8f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:01:cd', 'vm-uuid': '3816591d-6b75-4813-8651-e012289c6a41'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:04:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:08 user nova-compute[72780]: INFO os_vif [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7')
Aug 09 01:04:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:14:01:cd, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:04:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updated VIF entry in instance network info cache for port 38ba6593-b72d-4c53-8710-378da9c4c8f6. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:04:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updating instance_info_cache with network_info: [{"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c54bac8-3d03-4b93-948c-4be6d4c7bf94 req-e146cec6-ac7c-4d98-8ca5-c839fd28ca46 service nova] Releasing lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-2fb33e20-27f6-4270-99b3-2da32728697d req-8817be52-bc16-4ee2-8d47-841f2dd587be service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2fb33e20-27f6-4270-99b3-2da32728697d req-8817be52-bc16-4ee2-8d47-841f2dd587be service nova] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2fb33e20-27f6-4270-99b3-2da32728697d req-8817be52-bc16-4ee2-8d47-841f2dd587be service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2fb33e20-27f6-4270-99b3-2da32728697d req-8817be52-bc16-4ee2-8d47-841f2dd587be service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-2fb33e20-27f6-4270-99b3-2da32728697d req-8817be52-bc16-4ee2-8d47-841f2dd587be service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] No waiting events found dispatching network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:10 user nova-compute[72780]: WARNING nova.compute.manager [req-2fb33e20-27f6-4270-99b3-2da32728697d req-8817be52-bc16-4ee2-8d47-841f2dd587be service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received unexpected event network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 for instance with vm_state building and task_state spawning.
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543052.4540875, 3816591d-6b75-4813-8651-e012289c6a41 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] VM Resumed (Lifecycle Event)
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Instance spawned successfully.
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543052.4556284, 3816591d-6b75-4813-8651-e012289c6a41 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] VM Started (Lifecycle Event)
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:12 user nova-compute[72780]: INFO nova.compute.manager [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Took 6.29 seconds to build instance.
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-ba795e0a-e5ee-41ff-9a52-f8eb7c67955d req-d785df8f-1970-46c9-aa1a-c973ec5d27ec service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ba795e0a-e5ee-41ff-9a52-f8eb7c67955d req-d785df8f-1970-46c9-aa1a-c973ec5d27ec service nova] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ba795e0a-e5ee-41ff-9a52-f8eb7c67955d req-d785df8f-1970-46c9-aa1a-c973ec5d27ec service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ba795e0a-e5ee-41ff-9a52-f8eb7c67955d req-d785df8f-1970-46c9-aa1a-c973ec5d27ec service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-ba795e0a-e5ee-41ff-9a52-f8eb7c67955d req-d785df8f-1970-46c9-aa1a-c973ec5d27ec service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] No waiting events found dispatching network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:12 user nova-compute[72780]: WARNING nova.compute.manager [req-ba795e0a-e5ee-41ff-9a52-f8eb7c67955d req-d785df8f-1970-46c9-aa1a-c973ec5d27ec service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received unexpected event network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 for instance with vm_state active and task_state None.
Aug 09 01:04:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a1193a9-563b-4182-8d0d-f75b8e08e3ee tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.390s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzaNdZUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:15 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f4899c-1209-47f5-abc8-3702d48e2df7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:04:15 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[edee51fa-0283-49da-8bd7-1d7a40a3af03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31] added
Aug 09 01:04:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceaaa15-8d16-44d8-b8eb-79400e919ea0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd28257-aa85-4c16-9c84-6431faed11b6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzaNdZUE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzaNdZUE" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1480a848-9362-4e6a-b2b0-05f2ca4511f8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KzaNdZUE'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e37c11-9530-4a68-86da-1856888c7899]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a96c4-6326-4b8c-a8d9-5af4b950626e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f6e31-3039-4f9a-8564-1699bfbdde08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260]
Aug 09 01:04:15 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260] successful.
Aug 09 01:04:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc983e-6d46-4f6b-b522-88ac10c95b5c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bead74a-2a2b-4715-9028-2901265060dc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:15 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b750e9fe-ad09-4184-91f1-a6a9fc2f94ea]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzaNdZUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:04:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26366353938323561', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366353938323561', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:04:16 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:16 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:04:16 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:04:16 user nova-compute[72780]:   <serial>af577c11-92bb-4da9-9013-0b8970554e31</serial>
Aug 09 01:04:16 user nova-compute[72780]: </disk>
Aug 09 01:04:16 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No VIF found with MAC fa:16:3e:98:d9:2a, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:04:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e7c4919-04e2-4eaf-898b-c415dec422ae tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.639s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:04:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [{"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-c57928fc-08eb-407f-9e94-baf32611ac9e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:21 user nova-compute[72780]: INFO nova.compute.manager [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attaching volume 70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 to /dev/vdc
Aug 09 01:04:21 user nova-compute[72780]: DEBUG os_brick.utils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1da68d-3356-4a2f-bab5-f1e4d368812d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28c6e0f-ef4e-4a4e-a7d5-9da12bc97749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e34a4b-3a89-4cbd-9cf8-5b64b6b1c8b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ad83d-018d-439f-97d0-02654c9aaeab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:04:21 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:04:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb060639-fbeb-4600-920d-fee2a18de214]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG os_brick.utils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:21 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updating existing volume attachment record: b4ac85f8-c13c-415a-8880-c666b79fc3aa {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:25 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7091MB free_disk=25.204673767089844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance bbe38c09-7b3d-481a-b414-d70a0f89332b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78622ce1-353a-4022-9b64-db7ab1692d72 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 3816591d-6b75-4813-8651-e012289c6a41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:04:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Terminating instance
Aug 09 01:04:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-bdb6e059-e02c-4a86-89ce-d2799a23c193 req-bd242f0e-f683-4a02-89d5-7c740c5ddd0e service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-vif-unplugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bdb6e059-e02c-4a86-89ce-d2799a23c193 req-bd242f0e-f683-4a02-89d5-7c740c5ddd0e service nova] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bdb6e059-e02c-4a86-89ce-d2799a23c193 req-bd242f0e-f683-4a02-89d5-7c740c5ddd0e service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bdb6e059-e02c-4a86-89ce-d2799a23c193 req-bd242f0e-f683-4a02-89d5-7c740c5ddd0e service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-bdb6e059-e02c-4a86-89ce-d2799a23c193 req-bd242f0e-f683-4a02-89d5-7c740c5ddd0e service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] No waiting events found dispatching network-vif-unplugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-bdb6e059-e02c-4a86-89ce-d2799a23c193 req-bd242f0e-f683-4a02-89d5-7c740c5ddd0e service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-vif-unplugged-9441fd0c-536a-494e-83dd-6cba552ca2cb for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:04:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Instance destroyed successfully.
Aug 09 01:04:29 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lazy-loading 'resources' on Instance uuid bbe38c09-7b3d-481a-b414-d70a0f89332b {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:01:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-792179523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7921795',id=24,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6SzWkdkeChpEDwfG/gb/UwilPvPkIV3DPHGWUF9DdJERtqoMO8p5+sH/BzanLtdhHHMi8gs3IpF4eCDmFK7uCHwUYt2MUHfUfTLneCbmUlgvWmLfHh4USNtcN8IrA31Q==',key_name='tempest-keypair-223497019',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89ed02fd4f2445d292ae2d2ebf8d7bde',ramdisk_id='',reservation_id='r-p2znusi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1760079964',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b8b1600f374a0f93aa515a17e5fa32',uuid=bbe38c09-7b3d-481a-b414-d70a0f89332b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Converting VIF {"id": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "address": "fa:16:3e:93:2e:fe", "network": {"id": "fc88ff80-4f82-4dde-973c-d46c53560e7d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1995772615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89ed02fd4f2445d292ae2d2ebf8d7bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9441fd0c-53", "ovs_interfaceid": "9441fd0c-536a-494e-83dd-6cba552ca2cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG os_vif [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9441fd0c-53, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:04:29 user nova-compute[72780]: INFO os_vif [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:2e:fe,bridge_name='br-int',has_traffic_filtering=True,id=9441fd0c-536a-494e-83dd-6cba552ca2cb,network=Network(fc88ff80-4f82-4dde-973c-d46c53560e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9441fd0c-53')
Aug 09 01:04:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Deleting instance files /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b_del
Aug 09 01:04:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Deletion of /opt/stack/data/nova/instances/bbe38c09-7b3d-481a-b414-d70a0f89332b_del complete
Aug 09 01:04:29 user nova-compute[72780]: INFO nova.compute.manager [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 01:04:29 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:04:29 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:30 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Took 0.98 seconds to deallocate network for instance.
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:30 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Deleted allocations for instance bbe38c09-7b3d-481a-b414-d70a0f89332b
Aug 09 01:04:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] Acquiring lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] No waiting events found dispatching network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:30 user nova-compute[72780]: WARNING nova.compute.manager [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received unexpected event network-vif-plugged-9441fd0c-536a-494e-83dd-6cba552ca2cb for instance with vm_state deleted and task_state None.
Aug 09 01:04:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-37ed3cc3-a4aa-4851-ba2a-e6df54963344 req-1a803d7b-bf72-44c8-b5d0-a681abf52196 service nova] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Received event network-vif-deleted-9441fd0c-536a-494e-83dd-6cba552ca2cb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6a16c013-c8aa-4101-9033-3164d44fb522 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964 tempest-TestServerVolumeAttachScenarioOldVersion-1760079964-project-member] Lock "bbe38c09-7b3d-481a-b414-d70a0f89332b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoxnPjFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:32 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5cb014-c2e8-4bb9-b29f-7cd5d097386a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:04:32 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd1e2b6-015e-4b18-8f8f-2601db8b7e89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5] added
Aug 09 01:04:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9903bc6d-1a14-41e2-85dd-6ab6203ba17a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[814acacb-e85c-4b6c-8264-89105d403b6f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QoxnPjFG {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QoxnPjFG" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9bdc03-04f1-49e2-a97e-2e582a441d14]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QoxnPjFG'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f31faaf-7c7d-447e-bd39-237517b4eb22]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[250033f7-6d49-4ca1-ae98-84c1efe2512f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e31a58b-5574-48a7-99d6-e24e469bb2e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260]
Aug 09 01:04:32 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260] successful.
Aug 09 01:04:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[84df834d-52b9-4691-be88-18984b2bf746]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6198f618-5801-4525-a1bb-9943de2f83d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)
Aug 09 01:04:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[918abdf4-7064-4330-8cf9-c8dfb294cd7e]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:04:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoxnPjFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:04:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23464363866303130', 'path': '/dev/sdf'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464363866303130', 'path': '/dev/sdf'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:04:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:04:33 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:33 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:04:33 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:04:33 user nova-compute[72780]:   <serial>70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5</serial>
Aug 09 01:04:33 user nova-compute[72780]: </disk>
Aug 09 01:04:33 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:04:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] No VIF found with MAC fa:16:3e:98:d9:2a, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:04:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8c32965-2afe-4527-80b9-13f666044603 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.311s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:35 user nova-compute[72780]: INFO nova.compute.manager [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Detaching volume af577c11-92bb-4da9-9013-0b8970554e31
Aug 09 01:04:35 user nova-compute[72780]: INFO nova.virt.block_device [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attempting to driver detach volume af577c11-92bb-4da9-9013-0b8970554e31 from mountpoint /dev/vdb
Aug 09 01:04:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Attempting to detach device vdb from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:04:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:04:35 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:35 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:04:35 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:04:35 user nova-compute[72780]:   <serial>af577c11-92bb-4da9-9013-0b8970554e31</serial>
Aug 09 01:04:35 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:04:35 user nova-compute[72780]: </disk>
Aug 09 01:04:35 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:04:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully detached device vdb from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the persistent domain config.
Aug 09 01:04:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:04:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:04:35 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:35 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:04:35 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:04:35 user nova-compute[72780]:   <serial>af577c11-92bb-4da9-9013-0b8970554e31</serial>
Aug 09 01:04:35 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:04:35 user nova-compute[72780]: </disk>
Aug 09 01:04:35 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543076.2037966, 318b5ce7-b2af-4d57-a158-070713c3ebc7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:04:36 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully detached device vdb from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the live domain config.
Aug 09 01:04:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzaNdZUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:36 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a20f3d-d8f4-4330-b92f-310a79b84e81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e813e82-4be3-4317-954c-2c716e436e06]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)
Aug 09 01:04:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 (non-flash)
Aug 09 01:04:36 user nova-compute[72780]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)
Aug 09 01:04:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa07327a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e075b2c-7ad4-4079-94ea-c04343adc82d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d7929b-4b2b-44bb-a5a2-afee494f63cc]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436c630-e521-4677-833e-d5b713b10ff9]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1592e3fe-d851-4276-b733-5730806d776a]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[32660ace-f25f-41ce-9b8a-bc66e3cdc8c0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[11297a42-4a6c-495b-83ba-299c21e2e85c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260]
Aug 09 01:04:36 user nova-compute[72780]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31, portal: 172.16.0.220,3260] successful.
Aug 09 01:04:36 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af577c11-92bb-4da9-9013-0b8970554e31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1397394-cdea-4de3-977f-1208174a04e0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== disconnect_volume: return (328ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:36 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:04:37 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3daaade-dc32-4c47-91fe-a4f1450b85b6 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.037s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:38 user nova-compute[72780]: INFO nova.compute.manager [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Detaching volume 70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5
Aug 09 01:04:38 user nova-compute[72780]: INFO nova.virt.block_device [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Attempting to driver detach volume 70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 from mountpoint /dev/vdc
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Attempting to detach device vdc from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:04:38 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:38 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:04:38 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:04:38 user nova-compute[72780]:   <serial>70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5</serial>
Aug 09 01:04:38 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 01:04:38 user nova-compute[72780]: </disk>
Aug 09 01:04:38 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:04:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully detached device vdc from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the persistent domain config.
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:04:38 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:38 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:04:38 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:04:38 user nova-compute[72780]:   <serial>70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5</serial>
Aug 09 01:04:38 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 01:04:38 user nova-compute[72780]: </disk>
Aug 09 01:04:38 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543078.6415303, 318b5ce7-b2af-4d57-a158-070713c3ebc7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:04:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully detached device vdc from instance 318b5ce7-b2af-4d57-a158-070713c3ebc7 from the live domain config.
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoxnPjFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:38 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e237c-a3ed-48a6-a52e-cf2da1b84d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[95672ecb-6d19-4e69-9a09-644343609684]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)
Aug 09 01:04:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:38 user nova-compute[72780]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 (non-flash)
Aug 09 01:04:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa067b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5'): ({'sdf'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Removing single pathed devices sdf {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e51fc-5097-4b73-8294-e6ac544aae2e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0013982-20b9-4f1d-97f5-dd505fb63fac]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Flushing IO for device /dev/sdf {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da70513-045a-470b-8a40-9c7ae10763aa]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74c6945-4901-47be-88ce-9d93682bdfed]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c3e075-9c11-46f4-8608-50254faadf2a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b90872-2a6a-4c04-a466-44dce43d040d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260]
Aug 09 01:04:38 user nova-compute[72780]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5, portal: 172.16.0.220,3260] successful.
Aug 09 01:04:38 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70f5df0a-ace7-43ac-aa25-a9d1ec80c9c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1f212-626a-4aae-b68c-a9c381e1cab2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] <== disconnect_volume: return (343ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'flavor' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-552fde4b-f889-45f6-98df-a4bb672db37f tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:39 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:04:39 user nova-compute[72780]: INFO nova.compute.claims [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Claim successful on node user
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:04:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.policy [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d5adbbde00b43678092c96e19826a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f635836b7a148b7a1e12c818e5edaeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:04:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Creating image(s)
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:40 user nova-compute[72780]: INFO nova.compute.manager [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Terminating instance
Aug 09 01:04:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk 1073741824" returned: 0 in 0.054s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-01e334ca-6b44-4ec7-9433-f8f9e9e9fd71 req-8c6bdbb1-e7be-4a8c-b41c-7710f6519603 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-vif-unplugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-01e334ca-6b44-4ec7-9433-f8f9e9e9fd71 req-8c6bdbb1-e7be-4a8c-b41c-7710f6519603 service nova] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-01e334ca-6b44-4ec7-9433-f8f9e9e9fd71 req-8c6bdbb1-e7be-4a8c-b41c-7710f6519603 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-01e334ca-6b44-4ec7-9433-f8f9e9e9fd71 req-8c6bdbb1-e7be-4a8c-b41c-7710f6519603 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-01e334ca-6b44-4ec7-9433-f8f9e9e9fd71 req-8c6bdbb1-e7be-4a8c-b41c-7710f6519603 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] No waiting events found dispatching network-vif-unplugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-01e334ca-6b44-4ec7-9433-f8f9e9e9fd71 req-8c6bdbb1-e7be-4a8c-b41c-7710f6519603 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-vif-unplugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.177s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Cannot resize image /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.objects.instance [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'migration_context' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Ensure instance console log exists: /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.network.neutron [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Successfully created port: d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:04:41 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Instance destroyed successfully.
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lazy-loading 'resources' on Instance uuid 318b5ce7-b2af-4d57-a158-070713c3ebc7 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1342460866',display_name='tempest-AttachVolumeTestJSON-server-1342460866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1342460866',id=26,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL11FueI/S3bjAvZUcjRlwMaiD8yngpeo0ZMzs91x4ciX4HXBuEQ42ZMoIvB6rb7rQ9/62/BIuJK8ogHsxAnY9qmKZh5A3eMPugcRtuBwOJyZWo4ZmRGGGXbwU9tiu1SA==',key_name='tempest-keypair-821442165',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32ce26fa1a3947488856bfd876571471',ramdisk_id='',reservation_id='r-c0z6xup4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-760573544',owner_user_name='tempest-AttachVolumeTestJSON-760573544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f38504b4e824e7ea66ab9e8c56f0b50',uuid=318b5ce7-b2af-4d57-a158-070713c3ebc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converting VIF {"id": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "address": "fa:16:3e:98:d9:2a", "network": {"id": "04345a45-b635-4bc2-8257-5ce49399228b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-865397527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32ce26fa1a3947488856bfd876571471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9995e7c0-cf", "ovs_interfaceid": "9995e7c0-cfda-4997-9c7e-0df5fb8b751b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG os_vif [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9995e7c0-cf, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:04:41 user nova-compute[72780]: INFO os_vif [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:d9:2a,bridge_name='br-int',has_traffic_filtering=True,id=9995e7c0-cfda-4997-9c7e-0df5fb8b751b,network=Network(04345a45-b635-4bc2-8257-5ce49399228b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9995e7c0-cf')
Aug 09 01:04:41 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Deleting instance files /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7_del
Aug 09 01:04:41 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Deletion of /opt/stack/data/nova/instances/318b5ce7-b2af-4d57-a158-070713c3ebc7_del complete
Aug 09 01:04:41 user nova-compute[72780]: INFO nova.compute.manager [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 01:04:41 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:04:41 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Successfully updated port: d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing instance network info cache due to event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:42 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Took 0.82 seconds to deallocate network for instance.
Aug 09 01:04:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:04:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:42 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Deleted allocations for instance 318b5ce7-b2af-4d57-a158-070713c3ebc7
Aug 09 01:04:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance network_info: |[{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.neutron [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Start _get_guest_xml network_info=[{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7c315f12-0b91-4bdf-a022-479e43afa975 tempest-AttachVolumeTestJSON-760573544 tempest-AttachVolumeTestJSON-760573544-project-member] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] Acquiring lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] Lock "318b5ce7-b2af-4d57-a158-070713c3ebc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] No waiting events found dispatching network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:43 user nova-compute[72780]: WARNING nova.compute.manager [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received unexpected event network-vif-plugged-9995e7c0-cfda-4997-9c7e-0df5fb8b751b for instance with vm_state deleted and task_state None.
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-ded64a43-0aa6-4213-a65c-9237be3375a9 req-34d77aca-a580-494b-b174-6b33c165c404 service nova] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Received event network-vif-deleted-9995e7c0-cfda-4997-9c7e-0df5fb8b751b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:43 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:43 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1567257275',display_name='tempest-ServerStableDeviceRescueTest-server-1567257275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1567257275',id=31,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUzekflLmlc5LAkJ2IatdZQbNepkB4OsrCtPb1gR4RsNKgy6wIJTXSry7i+VdTW71w4+uZPP/x/hxiC1Ey1ZzrEmANlETYF6Stigj5NUnyU05i/BmaJEeeB2dwZ355dA==',key_name='tempest-keypair-904094662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f635836b7a148b7a1e12c818e5edaeb',ramdisk_id='',reservation_id='r-bwz2a2uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-506067792',owner_user_name='tempest-ServerStableDeviceRescueTest-506067792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d5adbbde00b43678092c96e19826a51',uuid=61c9d542-625d-4683-8b61-291c47d1fa91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converting VIF {"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.objects.instance [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'pci_devices' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:04:43 user nova-compute[72780]:   <uuid>61c9d542-625d-4683-8b61-291c47d1fa91</uuid>
Aug 09 01:04:43 user nova-compute[72780]:   <name>instance-0000001f</name>
Aug 09 01:04:43 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:04:43 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:04:43 user nova-compute[72780]:   <metadata>
Aug 09 01:04:43 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:04:43 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:04:43 user nova-compute[72780]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1567257275</nova:name>
Aug 09 01:04:43 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:04:43</nova:creationTime>
Aug 09 01:04:43 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:04:43 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:04:43 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:04:43 user nova-compute[72780]:       <nova:owner>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:user uuid="0d5adbbde00b43678092c96e19826a51">tempest-ServerStableDeviceRescueTest-506067792-project-member</nova:user>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:project uuid="8f635836b7a148b7a1e12c818e5edaeb">tempest-ServerStableDeviceRescueTest-506067792</nova:project>
Aug 09 01:04:43 user nova-compute[72780]:       </nova:owner>
Aug 09 01:04:43 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:04:43 user nova-compute[72780]:       <nova:ports>
Aug 09 01:04:43 user nova-compute[72780]:         <nova:port uuid="d51c0ac4-c7b3-4865-a20f-838a2a837956">
Aug 09 01:04:43 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:04:43 user nova-compute[72780]:         </nova:port>
Aug 09 01:04:43 user nova-compute[72780]:       </nova:ports>
Aug 09 01:04:43 user nova-compute[72780]:     </nova:instance>
Aug 09 01:04:43 user nova-compute[72780]:   </metadata>
Aug 09 01:04:43 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:04:43 user nova-compute[72780]:     <system>
Aug 09 01:04:43 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:04:43 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:04:43 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:04:43 user nova-compute[72780]:       <entry name="serial">61c9d542-625d-4683-8b61-291c47d1fa91</entry>
Aug 09 01:04:43 user nova-compute[72780]:       <entry name="uuid">61c9d542-625d-4683-8b61-291c47d1fa91</entry>
Aug 09 01:04:43 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:04:43 user nova-compute[72780]:     </system>
Aug 09 01:04:43 user nova-compute[72780]:   </sysinfo>
Aug 09 01:04:43 user nova-compute[72780]:   <os>
Aug 09 01:04:43 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:04:43 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:04:43 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:04:43 user nova-compute[72780]:   </os>
Aug 09 01:04:43 user nova-compute[72780]:   <features>
Aug 09 01:04:43 user nova-compute[72780]:     <acpi/>
Aug 09 01:04:43 user nova-compute[72780]:     <apic/>
Aug 09 01:04:43 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:04:43 user nova-compute[72780]:   </features>
Aug 09 01:04:43 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:04:43 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:04:43 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:04:43 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:04:43 user nova-compute[72780]:   </clock>
Aug 09 01:04:43 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:04:43 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:04:43 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:04:43 user nova-compute[72780]:   </cpu>
Aug 09 01:04:43 user nova-compute[72780]:   <devices>
Aug 09 01:04:43 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:04:43 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:04:43 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk"/>
Aug 09 01:04:43 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:04:43 user nova-compute[72780]:     </disk>
Aug 09 01:04:43 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:04:43 user nova-compute[72780]:       <mac address="fa:16:3e:d8:b6:0b"/>
Aug 09 01:04:43 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:04:43 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:04:43 user nova-compute[72780]:       <target dev="tapd51c0ac4-c7"/>
Aug 09 01:04:43 user nova-compute[72780]:     </interface>
Aug 09 01:04:43 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:04:43 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/console.log" append="off"/>
Aug 09 01:04:43 user nova-compute[72780]:     </serial>
Aug 09 01:04:43 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:04:43 user nova-compute[72780]:     <video>
Aug 09 01:04:43 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:04:43 user nova-compute[72780]:     </video>
Aug 09 01:04:43 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:04:43 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:04:43 user nova-compute[72780]:     </rng>
Aug 09 01:04:43 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:04:43 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:04:43 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:04:43 user nova-compute[72780]:     </memballoon>
Aug 09 01:04:43 user nova-compute[72780]:   </devices>
Aug 09 01:04:43 user nova-compute[72780]: </domain>
Aug 09 01:04:43 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1567257275',display_name='tempest-ServerStableDeviceRescueTest-server-1567257275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1567257275',id=31,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUzekflLmlc5LAkJ2IatdZQbNepkB4OsrCtPb1gR4RsNKgy6wIJTXSry7i+VdTW71w4+uZPP/x/hxiC1Ey1ZzrEmANlETYF6Stigj5NUnyU05i/BmaJEeeB2dwZ355dA==',key_name='tempest-keypair-904094662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f635836b7a148b7a1e12c818e5edaeb',ramdisk_id='',reservation_id='r-bwz2a2uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-506067792',owner_user_name='tempest-ServerStableDeviceRescueTest-506067792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d5adbbde00b43678092c96e19826a51',uuid=61c9d542-625d-4683-8b61-291c47d1fa91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converting VIF {"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG os_vif [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd51c0ac4-c7, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd51c0ac4-c7, col_values=(('external_ids', {'iface-id': 'd51c0ac4-c7b3-4865-a20f-838a2a837956', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:b6:0b', 'vm-uuid': '61c9d542-625d-4683-8b61-291c47d1fa91'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:43 user nova-compute[72780]: INFO os_vif [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7')
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No VIF found with MAC fa:16:3e:d8:b6:0b, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.neutron [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updated VIF entry in instance network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG nova.network.neutron [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07d91ecf-d528-4d3a-aa11-cbd40465b5bc req-cb4a26de-cbd2-449f-8dda-41921e8d8a6d service nova] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543069.3143094, bbe38c09-7b3d-481a-b414-d70a0f89332b => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:44 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] VM Stopped (Lifecycle Event)
Aug 09 01:04:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5b955a6d-7bfa-484b-bbd4-216eaec40435 None None] [instance: bbe38c09-7b3d-481a-b414-d70a0f89332b] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-1ad2b448-26b3-4fdc-ae8a-a35668ffb5a8 req-64e8d057-b26e-4f85-ba86-1b2964884f83 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1ad2b448-26b3-4fdc-ae8a-a35668ffb5a8 req-64e8d057-b26e-4f85-ba86-1b2964884f83 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1ad2b448-26b3-4fdc-ae8a-a35668ffb5a8 req-64e8d057-b26e-4f85-ba86-1b2964884f83 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1ad2b448-26b3-4fdc-ae8a-a35668ffb5a8 req-64e8d057-b26e-4f85-ba86-1b2964884f83 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-1ad2b448-26b3-4fdc-ae8a-a35668ffb5a8 req-64e8d057-b26e-4f85-ba86-1b2964884f83 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:44 user nova-compute[72780]: WARNING nova.compute.manager [req-1ad2b448-26b3-4fdc-ae8a-a35668ffb5a8 req-64e8d057-b26e-4f85-ba86-1b2964884f83 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state building and task_state spawning.
Aug 09 01:04:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543086.6773272, 61c9d542-625d-4683-8b61-291c47d1fa91 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Resumed (Lifecycle Event)
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance spawned successfully.
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543086.680769, 61c9d542-625d-4683-8b61-291c47d1fa91 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Started (Lifecycle Event)
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:46 user nova-compute[72780]: INFO nova.compute.manager [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Took 7.05 seconds to build instance.
Aug 09 01:04:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-243d131e-87ef-4d31-a924-f26650bfdc35 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.153s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d0365da-0288-47d1-942b-16ba39ce9f73 req-c570942f-50d8-4fa1-8ed6-0b43c102c36d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d0365da-0288-47d1-942b-16ba39ce9f73 req-c570942f-50d8-4fa1-8ed6-0b43c102c36d service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d0365da-0288-47d1-942b-16ba39ce9f73 req-c570942f-50d8-4fa1-8ed6-0b43c102c36d service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5d0365da-0288-47d1-942b-16ba39ce9f73 req-c570942f-50d8-4fa1-8ed6-0b43c102c36d service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-5d0365da-0288-47d1-942b-16ba39ce9f73 req-c570942f-50d8-4fa1-8ed6-0b43c102c36d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:46 user nova-compute[72780]: WARNING nova.compute.manager [req-5d0365da-0288-47d1-942b-16ba39ce9f73 req-c570942f-50d8-4fa1-8ed6-0b43c102c36d service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state None.
Aug 09 01:04:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:49 user nova-compute[72780]: INFO nova.compute.manager [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Rescuing
Aug 09 01:04:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating instance_info_cache with network_info: [{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-23d151d1-f653-492f-8f26-17753173fd5c req-af72e865-d062-4a2a-bf0c-5106416df760 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-23d151d1-f653-492f-8f26-17753173fd5c req-af72e865-d062-4a2a-bf0c-5106416df760 service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-23d151d1-f653-492f-8f26-17753173fd5c req-af72e865-d062-4a2a-bf0c-5106416df760 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-23d151d1-f653-492f-8f26-17753173fd5c req-af72e865-d062-4a2a-bf0c-5106416df760 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-23d151d1-f653-492f-8f26-17753173fd5c req-af72e865-d062-4a2a-bf0c-5106416df760 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:49 user nova-compute[72780]: WARNING nova.compute.manager [req-23d151d1-f653-492f-8f26-17753173fd5c req-af72e865-d062-4a2a-bf0c-5106416df760 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state active and task_state rescuing.
Aug 09 01:04:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance destroyed successfully.
Aug 09 01:04:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Attempting a stable device rescue
Aug 09 01:04:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72780) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 01:04:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 01:04:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Creating image(s)
Aug 09 01:04:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "/opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "/opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:50 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'trusted_certs' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "0644982efb75b1724910056905754e2d0ac2c99b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "0644982efb75b1724910056905754e2d0ac2c99b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG nova.virt.images [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] 3c82115b-f325-40fc-9c97-8789ca58af29 was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.part /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.part /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.converted" returned: 0 in 0.326s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-b561fb85-15fc-487a-a1aa-21b10449f218 req-29ac79e4-1a45-440a-87c4-b837a246c80d service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b561fb85-15fc-487a-a1aa-21b10449f218 req-29ac79e4-1a45-440a-87c4-b837a246c80d service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b561fb85-15fc-487a-a1aa-21b10449f218 req-29ac79e4-1a45-440a-87c4-b837a246c80d service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b561fb85-15fc-487a-a1aa-21b10449f218 req-29ac79e4-1a45-440a-87c4-b837a246c80d service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-b561fb85-15fc-487a-a1aa-21b10449f218 req-29ac79e4-1a45-440a-87c4-b837a246c80d service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:52 user nova-compute[72780]: WARNING nova.compute.manager [req-b561fb85-15fc-487a-a1aa-21b10449f218 req-29ac79e4-1a45-440a-87c4-b837a246c80d service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state active and task_state rescuing.
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "0644982efb75b1724910056905754e2d0ac2c99b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.654s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "0644982efb75b1724910056905754e2d0ac2c99b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "0644982efb75b1724910056905754e2d0ac2c99b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b,backing_fmt=raw /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b,backing_fmt=raw /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue" returned: 0 in 0.056s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "0644982efb75b1724910056905754e2d0ac2c99b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'migration_context' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Start _get_guest_xml network_info=[{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "vif_mac": "fa:16:3e:76:05:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3c82115b-f325-40fc-9c97-8789ca58af29', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '351a0f4e-b337-49ec-8dfb-cde20c1fbc3e', 'attached_at': '', 'detached_at': '', 'volume_id': '50899620-dc05-4248-8f59-068c949cebce', 'serial': '50899620-dc05-4248-8f59-068c949cebce'}, 'disk_bus': 'virtio', 'attachment_id': '06aa47c7-855c-441b-a81c-6ae00dce9581', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'resources' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'numa_topology' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:52 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:52 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'vcpu_model' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:04:52 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:52 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:04:52 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1778ae2-02aa-493c-8bfd-a24e08e8012b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lqSNbBRV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 01:04:52 user nova-compute[72780]: node.name = iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce
Aug 09 01:04:52 user nova-compute[72780]: node.tpgt = -1
Aug 09 01:04:52 user nova-compute[72780]: node.startup = automatic
Aug 09 01:04:52 user nova-compute[72780]: node.leading_login = No
Aug 09 01:04:52 user nova-compute[72780]: iface.iscsi_ifacename = default
Aug 09 01:04:52 user nova-compute[72780]: iface.net_ifacename = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.ipaddress = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.prefix_len = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.hwaddress = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.transport_name = tcp
Aug 09 01:04:52 user nova-compute[72780]: iface.initiatorname = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.vlan_id = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.vlan_priority = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.vlan_state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.iface_num = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.mtu = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.port = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.bootproto = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.subnet_mask = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.gateway = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_alt_client_id = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_dns = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_learn_iqn = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_vendor_id_state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_vendor_id = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.dhcp_slp_da = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.fragmentation = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.gratuitous_arp = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.incoming_forwarding = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.tos_state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.tos = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.ttl = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.delayed_ack = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.tcp_nagle = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.tcp_wsf_state = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.tcp_wsf = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.tcp_timer_scale = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.tcp_timestamp = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.redirect = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.def_task_mgmt_timeout = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.header_digest = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.data_digest = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.immediate_data = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.initial_r2t = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.data_seq_inorder = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.data_pdu_inorder = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.erl = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.max_receive_data_len = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.first_burst_len = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.max_outstanding_r2t = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.max_burst_len = 0
Aug 09 01:04:52 user nova-compute[72780]: iface.chap_auth = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.bidi_chap = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.strict_login_compliance = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.discovery_auth = <empty>
Aug 09 01:04:52 user nova-compute[72780]: iface.discovery_logout = <empty>
Aug 09 01:04:52 user nova-compute[72780]: node.discovery_address = <empty>
Aug 09 01:04:52 user nova-compute[72780]: node.discovery_port = 0
Aug 09 01:04:52 user nova-compute[72780]: node.discovery_type = static
Aug 09 01:04:52 user nova-compute[72780]: node.session.initial_cmdsn = 0
Aug 09 01:04:52 user nova-compute[72780]: node.session.initial_login_retry_max = 8
Aug 09 01:04:52 user nova-compute[72780]: node.session.xmit_thread_priority = -20
Aug 09 01:04:52 user nova-compute[72780]: node.session.cmds_max = 128
Aug 09 01:04:52 user nova-compute[72780]: node.session.queue_depth = 32
Aug 09 01:04:52 user nova-compute[72780]: node.session.nr_sessions = 1
Aug 09 01:04:52 user nova-compute[72780]: node.session.auth.authmethod = CHAP
Aug 09 01:04:52 user nova-compute[72780]: node.session.auth.username = lqSNbBRV
Aug 09 01:04:52 user nova-compute[72780]: node.session.auth.password = ***
Aug 09 01:04:52 user nova-compute[72780]: node.session.auth.username_in = <empty>
Aug 09 01:04:52 user nova-compute[72780]: node.session.auth.password_in = <empty>
Aug 09 01:04:52 user nova-compute[72780]: node.session.auth.chap_algs = MD5
Aug 09 01:04:52 user nova-compute[72780]: node.session.timeo.replacement_timeout = 120
Aug 09 01:04:52 user nova-compute[72780]: node.session.err_timeo.abort_timeout = 15
Aug 09 01:04:52 user nova-compute[72780]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 01:04:52 user nova-compute[72780]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 01:04:52 user nova-compute[72780]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.FastAbort = Yes
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.InitialR2T = No
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.ImmediateData = Yes
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.MaxConnections = 1
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 01:04:52 user nova-compute[72780]: node.session.iscsi.ERL = 0
Aug 09 01:04:52 user nova-compute[72780]: node.session.scan = manual
Aug 09 01:04:52 user nova-compute[72780]: node.session.reopen_max = 0
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].address = 172.16.0.220
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].port = 3260
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].startup = manual
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].tcp.window_size = 524288
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].tcp.type_of_service = 0
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].timeo.logout_timeout = 15
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].timeo.login_timeout = 15
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].timeo.auth_timeout = 45
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].iscsi.DataDigest = None
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].iscsi.IFMarker = No
Aug 09 01:04:52 user nova-compute[72780]: node.conn[0].iscsi.OFMarker = No
Aug 09 01:04:52 user nova-compute[72780]: # END RECORD
Aug 09 01:04:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.124s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d93f4-cdc3-46da-bc9e-8091bf4c8381]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aec2c03-3656-457f-b89d-bb37d25ef44e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqSNbBRV {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqSNbBRV" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4899ba-b26e-43ed-8dd8-645ce365237a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqSNbBRV'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f095c-4122-4a92-8e83-da78f9d917b2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0705ac91-ccef-4949-aaa8-4e25277cf5ac]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:52 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:52 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:52 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:04:52 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:04:52 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:04:52 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:04:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[34066a49-ff3b-49e0-a2d3-a2e4d1b3b35a]: (4, ('0 0 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.274s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== connect_volume: return (275ms) {'type': 'block', 'scsi_wwn': '26231313965656539', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231313965656539', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-467904036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-467904036',id=27,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-lv5bkzvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:03:24Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=351a0f4e-b337-49ec-8dfb-cde20c1fbc3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "vif_mac": "fa:16:3e:76:05:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "vif_mac": "fa:16:3e:76:05:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'pci_devices' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:04:52 user nova-compute[72780]:   <uuid>351a0f4e-b337-49ec-8dfb-cde20c1fbc3e</uuid>
Aug 09 01:04:52 user nova-compute[72780]:   <name>instance-0000001b</name>
Aug 09 01:04:52 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:04:52 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:04:52 user nova-compute[72780]:   <metadata>
Aug 09 01:04:52 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:04:52 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:04:52 user nova-compute[72780]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-467904036</nova:name>
Aug 09 01:04:52 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:04:52</nova:creationTime>
Aug 09 01:04:52 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:04:52 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:04:52 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:04:52 user nova-compute[72780]:       <nova:owner>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:user uuid="4c93725c6c7e4001b478b1c87d6ba759">tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member</nova:user>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:project uuid="b3d09b1579894f47877a117276c7465f">tempest-ServerBootFromVolumeStableRescueTest-1823004913</nova:project>
Aug 09 01:04:52 user nova-compute[72780]:       </nova:owner>
Aug 09 01:04:52 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:04:52 user nova-compute[72780]:       <nova:ports>
Aug 09 01:04:52 user nova-compute[72780]:         <nova:port uuid="4b08ec95-4889-4a7e-8d14-e849bb924edb">
Aug 09 01:04:52 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 01:04:52 user nova-compute[72780]:         </nova:port>
Aug 09 01:04:52 user nova-compute[72780]:       </nova:ports>
Aug 09 01:04:52 user nova-compute[72780]:     </nova:instance>
Aug 09 01:04:52 user nova-compute[72780]:   </metadata>
Aug 09 01:04:52 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:04:52 user nova-compute[72780]:     <system>
Aug 09 01:04:52 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:04:52 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:04:52 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:04:52 user nova-compute[72780]:       <entry name="serial">351a0f4e-b337-49ec-8dfb-cde20c1fbc3e</entry>
Aug 09 01:04:52 user nova-compute[72780]:       <entry name="uuid">351a0f4e-b337-49ec-8dfb-cde20c1fbc3e</entry>
Aug 09 01:04:52 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:04:52 user nova-compute[72780]:     </system>
Aug 09 01:04:52 user nova-compute[72780]:   </sysinfo>
Aug 09 01:04:52 user nova-compute[72780]:   <os>
Aug 09 01:04:52 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:04:52 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:04:52 user nova-compute[72780]:   </os>
Aug 09 01:04:52 user nova-compute[72780]:   <features>
Aug 09 01:04:52 user nova-compute[72780]:     <acpi/>
Aug 09 01:04:52 user nova-compute[72780]:     <apic/>
Aug 09 01:04:52 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:04:52 user nova-compute[72780]:   </features>
Aug 09 01:04:52 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:04:52 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:04:52 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:04:52 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:04:52 user nova-compute[72780]:   </clock>
Aug 09 01:04:52 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:04:52 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:04:52 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:04:52 user nova-compute[72780]:   </cpu>
Aug 09 01:04:52 user nova-compute[72780]:   <devices>
Aug 09 01:04:52 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:04:52 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:04:52 user nova-compute[72780]:       <source dev="/dev/sdd"/>
Aug 09 01:04:52 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:04:52 user nova-compute[72780]:       <serial>50899620-dc05-4248-8f59-068c949cebce</serial>
Aug 09 01:04:52 user nova-compute[72780]:     </disk>
Aug 09 01:04:52 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:04:52 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:04:52 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue"/>
Aug 09 01:04:52 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:04:52 user nova-compute[72780]:       <boot order="1"/>
Aug 09 01:04:52 user nova-compute[72780]:     </disk>
Aug 09 01:04:52 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:04:52 user nova-compute[72780]:       <mac address="fa:16:3e:76:05:1e"/>
Aug 09 01:04:52 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:04:52 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:04:52 user nova-compute[72780]:       <target dev="tap4b08ec95-48"/>
Aug 09 01:04:52 user nova-compute[72780]:     </interface>
Aug 09 01:04:52 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:04:52 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/console.log" append="off"/>
Aug 09 01:04:52 user nova-compute[72780]:     </serial>
Aug 09 01:04:52 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:04:52 user nova-compute[72780]:     <video>
Aug 09 01:04:52 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:04:52 user nova-compute[72780]:     </video>
Aug 09 01:04:52 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:04:52 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:04:52 user nova-compute[72780]:     </rng>
Aug 09 01:04:52 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:04:52 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:04:52 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:04:52 user nova-compute[72780]:     </memballoon>
Aug 09 01:04:52 user nova-compute[72780]:   </devices>
Aug 09 01:04:52 user nova-compute[72780]: </domain>
Aug 09 01:04:52 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:04:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance destroyed successfully.
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:04:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] No VIF found with MAC fa:16:3e:76:05:1e, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:04:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-2909f8f0-b507-4509-8814-1ccf84fd9001 req-dfff5062-019b-4584-9414-28d3780d4f0f service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2909f8f0-b507-4509-8814-1ccf84fd9001 req-dfff5062-019b-4584-9414-28d3780d4f0f service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2909f8f0-b507-4509-8814-1ccf84fd9001 req-dfff5062-019b-4584-9414-28d3780d4f0f service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2909f8f0-b507-4509-8814-1ccf84fd9001 req-dfff5062-019b-4584-9414-28d3780d4f0f service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-2909f8f0-b507-4509-8814-1ccf84fd9001 req-dfff5062-019b-4584-9414-28d3780d4f0f service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:54 user nova-compute[72780]: WARNING nova.compute.manager [req-2909f8f0-b507-4509-8814-1ccf84fd9001 req-dfff5062-019b-4584-9414-28d3780d4f0f service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state active and task_state rescuing.
Aug 09 01:04:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543096.373637, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Resumed (Lifecycle Event)
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4217dd58-ae9c-4af5-91ad-e7fa9fbc9c91 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:04:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543096.3752103, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:56 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Started (Lifecycle Event)
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543081.4827464, 318b5ce7-b2af-4d57-a158-070713c3ebc7 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:04:56 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] VM Stopped (Lifecycle Event)
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3e189545-31c4-4c76-a09d-e00a7c8b7d59 None None] [instance: 318b5ce7-b2af-4d57-a158-070713c3ebc7] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-6065e122-15ac-4839-aa5a-aa2178e1c903 req-6de79b9e-5687-4d7a-a3ef-9c55cbc9da3d service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6065e122-15ac-4839-aa5a-aa2178e1c903 req-6de79b9e-5687-4d7a-a3ef-9c55cbc9da3d service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6065e122-15ac-4839-aa5a-aa2178e1c903 req-6de79b9e-5687-4d7a-a3ef-9c55cbc9da3d service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6065e122-15ac-4839-aa5a-aa2178e1c903 req-6de79b9e-5687-4d7a-a3ef-9c55cbc9da3d service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:04:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-6065e122-15ac-4839-aa5a-aa2178e1c903 req-6de79b9e-5687-4d7a-a3ef-9c55cbc9da3d service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:04:56 user nova-compute[72780]: WARNING nova.compute.manager [req-6065e122-15ac-4839-aa5a-aa2178e1c903 req-6de79b9e-5687-4d7a-a3ef-9c55cbc9da3d service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state rescued and task_state None.
Aug 09 01:04:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78622ce1-353a-4022-9b64-db7ab1692d72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:00 user nova-compute[72780]: INFO nova.compute.manager [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Terminating instance
Aug 09 01:05:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-770296a2-932e-416e-a680-5e1e49d5903a req-44bee3f1-328c-4d80-b23f-883f710fc3e1 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-vif-unplugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-770296a2-932e-416e-a680-5e1e49d5903a req-44bee3f1-328c-4d80-b23f-883f710fc3e1 service nova] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-770296a2-932e-416e-a680-5e1e49d5903a req-44bee3f1-328c-4d80-b23f-883f710fc3e1 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-770296a2-932e-416e-a680-5e1e49d5903a req-44bee3f1-328c-4d80-b23f-883f710fc3e1 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-770296a2-932e-416e-a680-5e1e49d5903a req-44bee3f1-328c-4d80-b23f-883f710fc3e1 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] No waiting events found dispatching network-vif-unplugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-770296a2-932e-416e-a680-5e1e49d5903a req-44bee3f1-328c-4d80-b23f-883f710fc3e1 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-vif-unplugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Instance destroyed successfully.
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'resources' on Instance uuid 78622ce1-353a-4022-9b64-db7ab1692d72 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-796311580',display_name='tempest-TestVolumeBootPattern-server-796311580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-796311580',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-vxi0z7fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:03:32Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=78622ce1-353a-4022-9b64-db7ab1692d72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "address": "fa:16:3e:7b:82:84", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88bde42c-56", "ovs_interfaceid": "88bde42c-5684-4bd4-a29e-418d7cc7c7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_vif [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88bde42c-56, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:05:01 user nova-compute[72780]: INFO os_vif [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:82:84,bridge_name='br-int',has_traffic_filtering=True,id=88bde42c-5684-4bd4-a29e-418d7cc7c7b2,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88bde42c-56')
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuUSwWoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:05:01 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df7b6e-2cbb-4a0c-b527-42b417079f67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d0fcd5-7c55-4ed7-ab30-0d4ec4ffb99e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[877e6c8f-62b7-4a06-a4b0-32fd50b69c56]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d0fcd5-7c55-4ed7-ab30-0d4ec4ffb99e (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d0fcd5-7c55-4ed7-ab30-0d4ec4ffb99e (non-flash)
Aug 09 01:05:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa (non-flash)
Aug 09 01:05:01 user nova-compute[72780]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d0fcd5-7c55-4ed7-ab30-0d4ec4ffb99e (non-flash)
Aug 09 01:05:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06781f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa'): ({'sde'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Removing single pathed devices sde {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc48c89-7348-4d4e-ab03-0ba984495cae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d735b-067d-4d17-bf9f-0b562603d77a]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flushing IO for device /dev/sde {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[57847c36-538e-4272-b963-c111f0f1a332]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.076s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b4b929-bcf7-43fc-bb65-65eea3b5593b]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a70c4b', '/dev/disk/by-id/scsi-1SCST_BIO3a70c4b-59bc1acbcc8a3025', '/dev/disk/by-id/scsi-23539626331616362') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b792a5a1-8b75-4863-b300-fb441d8733f1]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a748f37-25eb-46d0-8422-c2fd7d0664cf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c540d-474c-4990-91b6-934d2f397c12]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260]
Aug 09 01:05:01 user nova-compute[72780]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa, portal: 172.16.0.220,3260] successful.
Aug 09 01:05:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30fe95c-0857-44f5-a3ab-a92648886eaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69692db-d724-47c0-88a5-f33d74b4bd74]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== disconnect_volume: return (448ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:05:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Deleting instance files /opt/stack/data/nova/instances/78622ce1-353a-4022-9b64-db7ab1692d72_del
Aug 09 01:05:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Deletion of /opt/stack/data/nova/instances/78622ce1-353a-4022-9b64-db7ab1692d72_del complete
Aug 09 01:05:01 user nova-compute[72780]: INFO nova.compute.manager [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Took 1.45 seconds to destroy the instance on the hypervisor.
Aug 09 01:05:01 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:02 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:05:02 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Took 0.62 seconds to deallocate network for instance.
Aug 09 01:05:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] Acquiring lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] Lock "78622ce1-353a-4022-9b64-db7ab1692d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] No waiting events found dispatching network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:05:02 user nova-compute[72780]: WARNING nova.compute.manager [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received unexpected event network-vif-plugged-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 for instance with vm_state active and task_state deleting.
Aug 09 01:05:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-6b0dee52-d785-46ae-8940-4f7ebaa0ffd5 req-d9989822-d5a1-4537-ad66-fc16f0403b03 service nova] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Received event network-vif-deleted-88bde42c-5684-4bd4-a29e-418d7cc7c7b2 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:03 user nova-compute[72780]: INFO nova.compute.manager [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Took 1.02 seconds to detach 1 volumes for instance.
Aug 09 01:05:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Deleting volume: a30fe95c-0857-44f5-a3ab-a92648886eaa {{(pid=72780) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 01:05:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:05:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:05:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:03 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Deleted allocations for instance 78622ce1-353a-4022-9b64-db7ab1692d72
Aug 09 01:05:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4eb72909-a822-4d16-9d69-b593ae4f41e8 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78622ce1-353a-4022-9b64-db7ab1692d72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.792s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:15 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543100.9884293, 78622ce1-353a-4022-9b64-db7ab1692d72 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:05:15 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] VM Stopped (Lifecycle Event)
Aug 09 01:05:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b9e6dca0-e571-4d53-ad4a-8aaa62144b53 None None] [instance: 78622ce1-353a-4022-9b64-db7ab1692d72] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:05:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updating instance_info_cache with network_info: [{"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:05:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:05:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:05:26 user nova-compute[72780]: INFO nova.compute.claims [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Claim successful on node user
Aug 09 01:05:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:27 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:05:27 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=25.096515655517578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.956s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.307s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:05:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 3816591d-6b75-4813-8651-e012289c6a41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.policy [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c08a00919854aaf9f20c0b66c54eb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdc20d829ea406fa62810d68d336ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:05:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Creating image(s)
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "/opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "/opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.128s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk 1073741824" returned: 0 in 0.048s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Cannot resize image /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lazy-loading 'migration_context' on Instance uuid 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Ensure instance console log exists: /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Successfully created port: d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Successfully updated port: d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "refresh_cache-9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquired lock "refresh_cache-9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-changed-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Refreshing instance network info cache due to event network-changed-d83fe230-9ae8-40a1-a0e6-148e8c7b120b. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] Acquiring lock "refresh_cache-9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:05:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Updating instance_info_cache with network_info: [{"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Releasing lock "refresh_cache-9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Instance network_info: |[{"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] Acquired lock "refresh_cache-9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Refreshing network info cache for port d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Start _get_guest_xml network_info=[{"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:05:30 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:05:30 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624523165',display_name='tempest-ServersNegativeTestJSON-server-624523165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624523165',id=32,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bdc20d829ea406fa62810d68d336ee9',ramdisk_id='',reservation_id='r-zgfmj9mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030464829',owner_user_name='tempest-ServersNegativeTestJSON-1030464829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:05:28Z,user_data=None,user_id='3c08a00919854aaf9f20c0b66c54eb21',uuid=9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converting VIF {"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:05:30 user nova-compute[72780]:   <uuid>9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48</uuid>
Aug 09 01:05:30 user nova-compute[72780]:   <name>instance-00000020</name>
Aug 09 01:05:30 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:05:30 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:05:30 user nova-compute[72780]:   <metadata>
Aug 09 01:05:30 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:05:30 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:05:30 user nova-compute[72780]:       <nova:name>tempest-ServersNegativeTestJSON-server-624523165</nova:name>
Aug 09 01:05:30 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:05:30</nova:creationTime>
Aug 09 01:05:30 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:05:30 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:05:30 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:05:30 user nova-compute[72780]:       <nova:owner>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:user uuid="3c08a00919854aaf9f20c0b66c54eb21">tempest-ServersNegativeTestJSON-1030464829-project-member</nova:user>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:project uuid="0bdc20d829ea406fa62810d68d336ee9">tempest-ServersNegativeTestJSON-1030464829</nova:project>
Aug 09 01:05:30 user nova-compute[72780]:       </nova:owner>
Aug 09 01:05:30 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:05:30 user nova-compute[72780]:       <nova:ports>
Aug 09 01:05:30 user nova-compute[72780]:         <nova:port uuid="d83fe230-9ae8-40a1-a0e6-148e8c7b120b">
Aug 09 01:05:30 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 01:05:30 user nova-compute[72780]:         </nova:port>
Aug 09 01:05:30 user nova-compute[72780]:       </nova:ports>
Aug 09 01:05:30 user nova-compute[72780]:     </nova:instance>
Aug 09 01:05:30 user nova-compute[72780]:   </metadata>
Aug 09 01:05:30 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:05:30 user nova-compute[72780]:     <system>
Aug 09 01:05:30 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:05:30 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:05:30 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:05:30 user nova-compute[72780]:       <entry name="serial">9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48</entry>
Aug 09 01:05:30 user nova-compute[72780]:       <entry name="uuid">9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48</entry>
Aug 09 01:05:30 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:05:30 user nova-compute[72780]:     </system>
Aug 09 01:05:30 user nova-compute[72780]:   </sysinfo>
Aug 09 01:05:30 user nova-compute[72780]:   <os>
Aug 09 01:05:30 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:05:30 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:05:30 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:05:30 user nova-compute[72780]:   </os>
Aug 09 01:05:30 user nova-compute[72780]:   <features>
Aug 09 01:05:30 user nova-compute[72780]:     <acpi/>
Aug 09 01:05:30 user nova-compute[72780]:     <apic/>
Aug 09 01:05:30 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:05:30 user nova-compute[72780]:   </features>
Aug 09 01:05:30 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:05:30 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:05:30 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:05:30 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:05:30 user nova-compute[72780]:   </clock>
Aug 09 01:05:30 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:05:30 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:05:30 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:05:30 user nova-compute[72780]:   </cpu>
Aug 09 01:05:30 user nova-compute[72780]:   <devices>
Aug 09 01:05:30 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:05:30 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:05:30 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk"/>
Aug 09 01:05:30 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:05:30 user nova-compute[72780]:     </disk>
Aug 09 01:05:30 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:05:30 user nova-compute[72780]:       <mac address="fa:16:3e:20:bc:48"/>
Aug 09 01:05:30 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:05:30 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:05:30 user nova-compute[72780]:       <target dev="tapd83fe230-9a"/>
Aug 09 01:05:30 user nova-compute[72780]:     </interface>
Aug 09 01:05:30 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:05:30 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/console.log" append="off"/>
Aug 09 01:05:30 user nova-compute[72780]:     </serial>
Aug 09 01:05:30 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:05:30 user nova-compute[72780]:     <video>
Aug 09 01:05:30 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:05:30 user nova-compute[72780]:     </video>
Aug 09 01:05:30 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:05:30 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:05:30 user nova-compute[72780]:     </rng>
Aug 09 01:05:30 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:05:30 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:05:30 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:05:30 user nova-compute[72780]:     </memballoon>
Aug 09 01:05:30 user nova-compute[72780]:   </devices>
Aug 09 01:05:30 user nova-compute[72780]: </domain>
Aug 09 01:05:30 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624523165',display_name='tempest-ServersNegativeTestJSON-server-624523165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624523165',id=32,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bdc20d829ea406fa62810d68d336ee9',ramdisk_id='',reservation_id='r-zgfmj9mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030464829',owner_user_name='tempest-ServersNegativeTestJSON-1030464829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:05:28Z,user_data=None,user_id='3c08a00919854aaf9f20c0b66c54eb21',uuid=9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converting VIF {"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG os_vif [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd83fe230-9a, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd83fe230-9a, col_values=(('external_ids', {'iface-id': 'd83fe230-9ae8-40a1-a0e6-148e8c7b120b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:bc:48', 'vm-uuid': '9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:30 user nova-compute[72780]: INFO os_vif [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a')
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] No VIF found with MAC fa:16:3e:20:bc:48, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Updated VIF entry in instance network info cache for port d83fe230-9ae8-40a1-a0e6-148e8c7b120b. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Updating instance_info_cache with network_info: [{"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ec0a7937-0b9b-4a37-a8a6-0cd914e7bc74 req-36e9558c-60f9-4459-bf9e-8a41ec3fc3c6 service nova] Releasing lock "refresh_cache-9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:05:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-9eab1fff-4e3b-40c0-a236-89539f3cac92 req-613f7b70-c160-49ac-8b20-db6bc6fb1511 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9eab1fff-4e3b-40c0-a236-89539f3cac92 req-613f7b70-c160-49ac-8b20-db6bc6fb1511 service nova] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9eab1fff-4e3b-40c0-a236-89539f3cac92 req-613f7b70-c160-49ac-8b20-db6bc6fb1511 service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9eab1fff-4e3b-40c0-a236-89539f3cac92 req-613f7b70-c160-49ac-8b20-db6bc6fb1511 service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-9eab1fff-4e3b-40c0-a236-89539f3cac92 req-613f7b70-c160-49ac-8b20-db6bc6fb1511 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] No waiting events found dispatching network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:05:32 user nova-compute[72780]: WARNING nova.compute.manager [req-9eab1fff-4e3b-40c0-a236-89539f3cac92 req-613f7b70-c160-49ac-8b20-db6bc6fb1511 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received unexpected event network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b for instance with vm_state building and task_state spawning.
Aug 09 01:05:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [req-2ac80381-ab23-4e74-a7f8-36b22aa64bdd req-d7752c44-79c9-48f1-ba36-25af3a51a0e1 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2ac80381-ab23-4e74-a7f8-36b22aa64bdd req-d7752c44-79c9-48f1-ba36-25af3a51a0e1 service nova] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2ac80381-ab23-4e74-a7f8-36b22aa64bdd req-d7752c44-79c9-48f1-ba36-25af3a51a0e1 service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2ac80381-ab23-4e74-a7f8-36b22aa64bdd req-d7752c44-79c9-48f1-ba36-25af3a51a0e1 service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [req-2ac80381-ab23-4e74-a7f8-36b22aa64bdd req-d7752c44-79c9-48f1-ba36-25af3a51a0e1 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] No waiting events found dispatching network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:05:34 user nova-compute[72780]: WARNING nova.compute.manager [req-2ac80381-ab23-4e74-a7f8-36b22aa64bdd req-d7752c44-79c9-48f1-ba36-25af3a51a0e1 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received unexpected event network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b for instance with vm_state building and task_state spawning.
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543134.4202607, 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] VM Resumed (Lifecycle Event)
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Instance spawned successfully.
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543134.4215813, 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] VM Started (Lifecycle Event)
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 09 01:05:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:05:34 user nova-compute[72780]: INFO nova.compute.manager [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Took 8.16 seconds to build instance.
Aug 09 01:05:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b2402d73-d6e5-4349-a555-c5e4aba8b4a7 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.260s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:05:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:05:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:05:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:05:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:05:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:53 user nova-compute[72780]: INFO nova.compute.manager [None req-a5cb7a1e-e2d4-4024-89bc-4b9488e55b65 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Get console output
Aug 09 01:05:53 user nova-compute[72780]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 01:05:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:05:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-changed-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:05:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Refreshing instance network info cache due to event network-changed-38ba6593-b72d-4c53-8710-378da9c4c8f6. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:05:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] Acquiring lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:05:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] Acquired lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:05:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Refreshing network info cache for port 38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:05:58 user nova-compute[72780]: DEBUG nova.network.neutron [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updated VIF entry in instance network info cache for port 38ba6593-b72d-4c53-8710-378da9c4c8f6. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:05:58 user nova-compute[72780]: DEBUG nova.network.neutron [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updating instance_info_cache with network_info: [{"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:05:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-425a40e1-d9b7-4717-94b7-5051aa285e94 req-20fd20b6-fc58-429b-a903-6f88aa3e383f service nova] Releasing lock "refresh_cache-3816591d-6b75-4813-8651-e012289c6a41" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:06:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:02 user nova-compute[72780]: DEBUG nova.objects.instance [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:06:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:02 user nova-compute[72780]: INFO nova.compute.manager [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Attaching volume 6afa84f0-7b7f-4424-9df9-1c391b9874f0 to /dev/vdb
Aug 09 01:06:03 user nova-compute[72780]: DEBUG os_brick.utils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e37ae58-a71e-4204-afa6-31a969730d03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462d5eb-3d9e-4fb7-808a-d662b6e8e35f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be544d-de36-4bed-99cc-4e254228123c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf1dbb-df57-4a7c-ba96-3cdafea21208]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:06:03 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:06:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5591dc0-d623-4ac2-a6a7-017f1b42fb78]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG os_brick.utils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:06:03 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updating existing volume attachment record: 68ec6d80-64cb-409a-8f1b-2b6fe8917547 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:06:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:06:11 user nova-compute[72780]: INFO nova.compute.claims [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Claim successful on node user
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:06:11 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:06:11 user nova-compute[72780]: INFO nova.virt.block_device [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Booting with volume ecb3695b-c8c1-43ce-87e7-ec115618264b at /dev/vda
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.policy [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54101aceab04126ba338c9965790cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9933f68af5d6419e92195eb3b49687a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG os_brick.utils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2842a82c-3da0-4790-916c-f1df31ae6256]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e10950-d030-4961-a382-34b183b195cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0e97a0-1839-4daf-ab48-c788a8ca50a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2fa890-5de2-44ea-8aaf-cb695da70ca9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:06:11 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:06:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84fdc0c-4141-46d1-94a6-258b969f6853]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG os_brick.utils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:06:11 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updating existing volume attachment record: c30a22db-b15f-4478-987d-511545dec8d8 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:06:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Successfully created port: 072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Successfully updated port: 072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquired lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-changed-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Refreshing instance network info cache due to event network-changed-072b2587-415f-4c16-b677-30d737fb021d. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] Acquiring lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updating instance_info_cache with network_info: [{"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Releasing lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Instance network_info: |[{"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] Acquired lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Refreshing network info cache for port 072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updated VIF entry in instance network info cache for port 072b2587-415f-4c16-b677-30d737fb021d. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG nova.network.neutron [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updating instance_info_cache with network_info: [{"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:06:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-005c9f6e-ffd8-4927-97e8-f4b153c9b5dc req-f8367c26-ddd5-4726-a6c4-4b3f5c86fc6b service nova] Releasing lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:06:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:06:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:06:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [{"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-a76eeaad-0c42-45c7-8351-a3dacdad0574" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:06:22 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzIxSAaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:06:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:06:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:06:23 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0551acf3-3752-4c7c-ada5-2fc6192195fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:06:23 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad0f1f-4c38-4699-8bb2-79fecb686bbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0] added
Aug 09 01:06:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cea8f3-bff4-4d8f-8278-201e364ac267]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[65079b7f-a9c3-4dff-80d1-ca3e4a55c09b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzIxSAaL {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KzIxSAaL" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d66471-b22f-49b8-9eca-2ca238b35a01]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KzIxSAaL'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ceef7d-f28c-4d58-a7c7-9190837665c1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e9b3ea-2d24-42ff-9570-70932df1b641]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe0acf-58db-43f5-a6a0-0196c2254518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260]
Aug 09 01:06:23 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260] successful.
Aug 09 01:06:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1349d0-f508-400a-a277-f10af9a27c15]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed4dff0-3c02-4b15-ad94-57c2a3f8f80d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:23 user nova-compute[72780]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 (non-flash)
Aug 09 01:06:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e982fb-da21-437f-9495-0be9b38c4732]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:06:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzIxSAaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23434353432363135', 'path': '/dev/sdf'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353432363135', 'path': '/dev/sdf'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:06:25 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:06:25 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:06:25 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:06:25 user nova-compute[72780]:   <serial>6afa84f0-7b7f-4424-9df9-1c391b9874f0</serial>
Aug 09 01:06:25 user nova-compute[72780]: </disk>
Aug 09 01:06:25 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:14:01:cd, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eca56fe2-09ff-4e85-83d1-61a15d1f0023 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.818s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:06:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:27 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:06:27 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.055259704589844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:27 user nova-compute[72780]: INFO nova.compute.manager [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Detaching volume 6afa84f0-7b7f-4424-9df9-1c391b9874f0
Aug 09 01:06:27 user nova-compute[72780]: INFO nova.virt.block_device [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Attempting to driver detach volume 6afa84f0-7b7f-4424-9df9-1c391b9874f0 from mountpoint /dev/vdb
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Attempting to detach device vdb from instance 3816591d-6b75-4813-8651-e012289c6a41 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:06:27 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:06:27 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:06:27 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:06:27 user nova-compute[72780]:   <serial>6afa84f0-7b7f-4424-9df9-1c391b9874f0</serial>
Aug 09 01:06:27 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:06:27 user nova-compute[72780]: </disk>
Aug 09 01:06:27 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:06:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully detached device vdb from instance 3816591d-6b75-4813-8651-e012289c6a41 from the persistent domain config.
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3816591d-6b75-4813-8651-e012289c6a41 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:06:27 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:06:27 user nova-compute[72780]:   <source dev="/dev/sdf"/>
Aug 09 01:06:27 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:06:27 user nova-compute[72780]:   <serial>6afa84f0-7b7f-4424-9df9-1c391b9874f0</serial>
Aug 09 01:06:27 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:06:27 user nova-compute[72780]: </disk>
Aug 09 01:06:27 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 3816591d-6b75-4813-8651-e012289c6a41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 82b3d395-7aec-4312-8bdd-50a84e8f3830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:06:27 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543188.066936, 3816591d-6b75-4813-8651-e012289c6a41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:06:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully detached device vdb from instance 3816591d-6b75-4813-8651-e012289c6a41 from the live domain config.
Aug 09 01:06:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KzIxSAaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:06:28 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bff06e-3e23-4cd1-8056-c5119b7760e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[120564cd-348e-401c-9dc3-62fbae8b2794]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 (non-flash)
Aug 09 01:06:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:28 user nova-compute[72780]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 (non-flash)
Aug 09 01:06:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa067a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0'): ({'sdf'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Removing single pathed devices sdf {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a983c1-f178-48c2-ac12-abb429c154e0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba9a38-d50f-4663-90ba-d8ccbdc96fef]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flushing IO for device /dev/sdf {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[572838ca-1957-4415-be5c-0a11cdbe3cd0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59735445-fb24-4c2c-8bd3-79c10f01d15a]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45f91d-9dbb-4e80-a218-8a2d90afeed2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5714d9-2152-4339-ac96-6b2c9539804f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260]
Aug 09 01:06:28 user nova-compute[72780]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0, portal: 172.16.0.220,3260] successful.
Aug 09 01:06:28 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6afa84f0-7b7f-4424-9df9-1c391b9874f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdc8a0-2179-4f01-a2d7-744aabdfd040]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== disconnect_volume: return (322ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:06:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing instance network info cache due to event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:06:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updated VIF entry in instance network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:06:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:06:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-96e1dd2b-7390-41ba-9fb8-9712380c6e96 req-bbc1842a-fc29-4975-a7fa-b89574a4de26 service nova] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:32 user nova-compute[72780]: INFO nova.compute.manager [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] instance snapshotting
Aug 09 01:06:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Beginning live snapshot process
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json -f qcow2 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5yhvwdqv/fe6e154f3b2c4043957978c625ab8c87.delta 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5yhvwdqv/fe6e154f3b2c4043957978c625ab8c87.delta 1073741824" returned: 0 in 0.051s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 01:06:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:06:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Creating image(s)
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Ensure instance console log exists: /opt/stack/data/nova/instances/82b3d395-7aec-4312-8bdd-50a84e8f3830/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Start _get_guest_xml network_info=[{"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiGdELAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82b3d395-7aec-4312-8bdd-50a84e8f3830', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecb3695b-c8c1-43ce-87e7-ec115618264b', 'serial': 'ecb3695b-c8c1-43ce-87e7-ec115618264b'}, 'disk_bus': 'virtio', 'attachment_id': 'c30a22db-b15f-4478-987d-511545dec8d8', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:06:34 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:06:34 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ce7af84f-1489-4e32-b6c6-9fcbc5ac8cb5 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.682s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiGdELAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:06:34 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:06:34 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:06:34 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72780) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 01:06:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d4694-336f-47e8-b129-5966f6d2432a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:06:34 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[359630ff-7a85-477a-a690-b95f11fe735d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b] added
Aug 09 01:06:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3fd174-d6bc-4991-8251-3a699da09698]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5yhvwdqv/fe6e154f3b2c4043957978c625ab8c87.delta /opt/stack/data/nova/instances/snapshots/tmp5yhvwdqv/fe6e154f3b2c4043957978c625ab8c87 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[67882228-5119-4303-bf29-892188e18f50]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiGdELAh {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiGdELAh" returned: 0 in 0.055s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a49aa5-9fce-4cc9-b8e6-b93341a0f0cf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PiGdELAh'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78b0fb3-c35e-4414-bae1-d492043a1494]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c97ab80-79b0-4891-b39b-3ab737077eee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f69598-aa84-4d48-8b5f-1cd3c800569a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260]
Aug 09 01:06:34 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260] successful.
Aug 09 01:06:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a35db1-04b3-4877-8d36-622c99ba3df6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8beccf-2bf7-48fe-9835-e9f3b614dec6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:06:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cba43cd6-dfdb-4248-9fe6-fbba2adb8e95 (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344bdc42-be5c-46bb-aaed-234b3260f7aa (non-flash)
Aug 09 01:06:34 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:06:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[50256552-c526-4656-8baa-908d0f1accb4]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5yhvwdqv/fe6e154f3b2c4043957978c625ab8c87.delta /opt/stack/data/nova/instances/snapshots/tmp5yhvwdqv/fe6e154f3b2c4043957978c625ab8c87" returned: 0 in 0.685s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Snapshot extracted, beginning image upload
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiGdELAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '26530383664313033', 'path': '/dev/sdf'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530383664313033', 'path': '/dev/sdf'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-864232018',display_name='tempest-TestVolumeBootPattern-volume-backed-server-864232018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-864232018',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnVo78fm51DcK+haWyMf6CHs8VbGE65tH9fd3eFyjEiTaUy+yM8C2l43GLukDhwRiraCYWz7Az6KRZYLuE8AdVSD0YAGRFPtZlTsbYln48neVw5dhUpvMr4yJm6Mwd/3Q==',key_name='tempest-keypair-1022615801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-83abk4xc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54101aceab04126ba338c9965790cf3',uuid=82b3d395-7aec-4312-8bdd-50a84e8f3830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.objects.instance [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'pci_devices' on Instance uuid 82b3d395-7aec-4312-8bdd-50a84e8f3830 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:06:35 user nova-compute[72780]:   <uuid>82b3d395-7aec-4312-8bdd-50a84e8f3830</uuid>
Aug 09 01:06:35 user nova-compute[72780]:   <name>instance-00000021</name>
Aug 09 01:06:35 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:06:35 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:06:35 user nova-compute[72780]:   <metadata>
Aug 09 01:06:35 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:06:35 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:06:35 user nova-compute[72780]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-864232018</nova:name>
Aug 09 01:06:35 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:06:34</nova:creationTime>
Aug 09 01:06:35 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:06:35 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:06:35 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:06:35 user nova-compute[72780]:       <nova:owner>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:user uuid="d54101aceab04126ba338c9965790cf3">tempest-TestVolumeBootPattern-1708118170-project-member</nova:user>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:project uuid="9933f68af5d6419e92195eb3b49687a8">tempest-TestVolumeBootPattern-1708118170</nova:project>
Aug 09 01:06:35 user nova-compute[72780]:       </nova:owner>
Aug 09 01:06:35 user nova-compute[72780]:       <nova:ports>
Aug 09 01:06:35 user nova-compute[72780]:         <nova:port uuid="072b2587-415f-4c16-b677-30d737fb021d">
Aug 09 01:06:35 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 01:06:35 user nova-compute[72780]:         </nova:port>
Aug 09 01:06:35 user nova-compute[72780]:       </nova:ports>
Aug 09 01:06:35 user nova-compute[72780]:     </nova:instance>
Aug 09 01:06:35 user nova-compute[72780]:   </metadata>
Aug 09 01:06:35 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:06:35 user nova-compute[72780]:     <system>
Aug 09 01:06:35 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:06:35 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:06:35 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:06:35 user nova-compute[72780]:       <entry name="serial">82b3d395-7aec-4312-8bdd-50a84e8f3830</entry>
Aug 09 01:06:35 user nova-compute[72780]:       <entry name="uuid">82b3d395-7aec-4312-8bdd-50a84e8f3830</entry>
Aug 09 01:06:35 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:06:35 user nova-compute[72780]:     </system>
Aug 09 01:06:35 user nova-compute[72780]:   </sysinfo>
Aug 09 01:06:35 user nova-compute[72780]:   <os>
Aug 09 01:06:35 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:06:35 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:06:35 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:06:35 user nova-compute[72780]:   </os>
Aug 09 01:06:35 user nova-compute[72780]:   <features>
Aug 09 01:06:35 user nova-compute[72780]:     <acpi/>
Aug 09 01:06:35 user nova-compute[72780]:     <apic/>
Aug 09 01:06:35 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:06:35 user nova-compute[72780]:   </features>
Aug 09 01:06:35 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:06:35 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:06:35 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:06:35 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:06:35 user nova-compute[72780]:   </clock>
Aug 09 01:06:35 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:06:35 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:06:35 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:06:35 user nova-compute[72780]:   </cpu>
Aug 09 01:06:35 user nova-compute[72780]:   <devices>
Aug 09 01:06:35 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:06:35 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:06:35 user nova-compute[72780]:       <source dev="/dev/sdf"/>
Aug 09 01:06:35 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:06:35 user nova-compute[72780]:       <serial>ecb3695b-c8c1-43ce-87e7-ec115618264b</serial>
Aug 09 01:06:35 user nova-compute[72780]:     </disk>
Aug 09 01:06:35 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:06:35 user nova-compute[72780]:       <mac address="fa:16:3e:03:72:66"/>
Aug 09 01:06:35 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:06:35 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:06:35 user nova-compute[72780]:       <target dev="tap072b2587-41"/>
Aug 09 01:06:35 user nova-compute[72780]:     </interface>
Aug 09 01:06:35 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:06:35 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/82b3d395-7aec-4312-8bdd-50a84e8f3830/console.log" append="off"/>
Aug 09 01:06:35 user nova-compute[72780]:     </serial>
Aug 09 01:06:35 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:06:35 user nova-compute[72780]:     <video>
Aug 09 01:06:35 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:06:35 user nova-compute[72780]:     </video>
Aug 09 01:06:35 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:06:35 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:06:35 user nova-compute[72780]:     </rng>
Aug 09 01:06:35 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:06:35 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:06:35 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:06:35 user nova-compute[72780]:     </memballoon>
Aug 09 01:06:35 user nova-compute[72780]:   </devices>
Aug 09 01:06:35 user nova-compute[72780]: </domain>
Aug 09 01:06:35 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-864232018',display_name='tempest-TestVolumeBootPattern-volume-backed-server-864232018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-864232018',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnVo78fm51DcK+haWyMf6CHs8VbGE65tH9fd3eFyjEiTaUy+yM8C2l43GLukDhwRiraCYWz7Az6KRZYLuE8AdVSD0YAGRFPtZlTsbYln48neVw5dhUpvMr4yJm6Mwd/3Q==',key_name='tempest-keypair-1022615801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-83abk4xc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54101aceab04126ba338c9965790cf3',uuid=82b3d395-7aec-4312-8bdd-50a84e8f3830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG os_vif [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap072b2587-41, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap072b2587-41, col_values=(('external_ids', {'iface-id': '072b2587-415f-4c16-b677-30d737fb021d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:72:66', 'vm-uuid': '82b3d395-7aec-4312-8bdd-50a84e8f3830'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:35 user nova-compute[72780]: INFO os_vif [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41')
Aug 09 01:06:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:06:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No VIF found with MAC fa:16:3e:03:72:66, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:06:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-0b8891b7-c80a-4300-86ba-a6d8532dd5a6 req-bcb7fa84-de43-4271-b285-1677e9e0ab58 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0b8891b7-c80a-4300-86ba-a6d8532dd5a6 req-bcb7fa84-de43-4271-b285-1677e9e0ab58 service nova] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0b8891b7-c80a-4300-86ba-a6d8532dd5a6 req-bcb7fa84-de43-4271-b285-1677e9e0ab58 service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0b8891b7-c80a-4300-86ba-a6d8532dd5a6 req-bcb7fa84-de43-4271-b285-1677e9e0ab58 service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-0b8891b7-c80a-4300-86ba-a6d8532dd5a6 req-bcb7fa84-de43-4271-b285-1677e9e0ab58 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] No waiting events found dispatching network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:37 user nova-compute[72780]: WARNING nova.compute.manager [req-0b8891b7-c80a-4300-86ba-a6d8532dd5a6 req-bcb7fa84-de43-4271-b285-1677e9e0ab58 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received unexpected event network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d for instance with vm_state building and task_state spawning.
Aug 09 01:06:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Snapshot image upload complete
Aug 09 01:06:38 user nova-compute[72780]: INFO nova.compute.manager [None req-d8d2d222-22b4-42bb-a071-8b4b6093efe8 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Took 6.63 seconds to snapshot the instance on the hypervisor.
Aug 09 01:06:39 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543199.9432552, 82b3d395-7aec-4312-8bdd-50a84e8f3830 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:06:39 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] VM Resumed (Lifecycle Event)
Aug 09 01:06:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:06:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:06:39 user nova-compute[72780]: INFO nova.compute.manager [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Unrescuing
Aug 09 01:06:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:06:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquired lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:06:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:06:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Instance spawned successfully.
Aug 09 01:06:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:06:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-3829296a-8c78-45d8-8f63-8c8b556c6502 req-7617b3a2-5a6c-42af-be88-09e8d9694c2a service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3829296a-8c78-45d8-8f63-8c8b556c6502 req-7617b3a2-5a6c-42af-be88-09e8d9694c2a service nova] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3829296a-8c78-45d8-8f63-8c8b556c6502 req-7617b3a2-5a6c-42af-be88-09e8d9694c2a service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3829296a-8c78-45d8-8f63-8c8b556c6502 req-7617b3a2-5a6c-42af-be88-09e8d9694c2a service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-3829296a-8c78-45d8-8f63-8c8b556c6502 req-7617b3a2-5a6c-42af-be88-09e8d9694c2a service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] No waiting events found dispatching network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:40 user nova-compute[72780]: WARNING nova.compute.manager [req-3829296a-8c78-45d8-8f63-8c8b556c6502 req-7617b3a2-5a6c-42af-be88-09e8d9694c2a service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received unexpected event network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d for instance with vm_state building and task_state spawning.
Aug 09 01:06:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543199.9465008, 82b3d395-7aec-4312-8bdd-50a84e8f3830 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:06:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] VM Started (Lifecycle Event)
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:06:40 user nova-compute[72780]: INFO nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:40 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:06:40 user nova-compute[72780]: INFO nova.compute.manager [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Took 29.14 seconds to build instance.
Aug 09 01:06:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-24306fcc-5692-47f1-a490-763b78d2d1bc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.256s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating instance_info_cache with network_info: [{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Releasing lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'flavor' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-c955fd06-b5ec-4ad7-8119-3b26046cccef req-6ebaa3d3-ea3e-4330-a872-9f93eeea71f1 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c955fd06-b5ec-4ad7-8119-3b26046cccef req-6ebaa3d3-ea3e-4330-a872-9f93eeea71f1 service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c955fd06-b5ec-4ad7-8119-3b26046cccef req-6ebaa3d3-ea3e-4330-a872-9f93eeea71f1 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c955fd06-b5ec-4ad7-8119-3b26046cccef req-6ebaa3d3-ea3e-4330-a872-9f93eeea71f1 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-c955fd06-b5ec-4ad7-8119-3b26046cccef req-6ebaa3d3-ea3e-4330-a872-9f93eeea71f1 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:41 user nova-compute[72780]: WARNING nova.compute.manager [req-c955fd06-b5ec-4ad7-8119-3b26046cccef req-6ebaa3d3-ea3e-4330-a872-9f93eeea71f1 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:06:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:41 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance destroyed successfully.
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-104227f0-4abb-42e3-b7f9-e95179afb1d7 req-f094c877-8352-49a3-89c7-894e48925e32 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-104227f0-4abb-42e3-b7f9-e95179afb1d7 req-f094c877-8352-49a3-89c7-894e48925e32 service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-104227f0-4abb-42e3-b7f9-e95179afb1d7 req-f094c877-8352-49a3-89c7-894e48925e32 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-104227f0-4abb-42e3-b7f9-e95179afb1d7 req-f094c877-8352-49a3-89c7-894e48925e32 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG nova.compute.manager [req-104227f0-4abb-42e3-b7f9-e95179afb1d7 req-f094c877-8352-49a3-89c7-894e48925e32 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:43 user nova-compute[72780]: WARNING nova.compute.manager [req-104227f0-4abb-42e3-b7f9-e95179afb1d7 req-f094c877-8352-49a3-89c7-894e48925e32 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:45 user nova-compute[72780]: WARNING nova.compute.manager [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:45 user nova-compute[72780]: WARNING nova.compute.manager [req-cc12c1dc-4ea2-4add-9081-b88bd42a84ba req-c2c9476d-e63b-42b3-acf5-a491422f3853 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543205.4307122, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:06:45 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Resumed (Lifecycle Event)
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-e23491ef-576c-418c-a16e-ae79bbe76950 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:06:45 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543205.4341917, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:06:45 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Started (Lifecycle Event)
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:54 user nova-compute[72780]: INFO nova.compute.manager [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Terminating instance
Aug 09 01:06:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-c09e5b31-a64b-4264-87d4-62c9249421af req-e21c3e17-5d2a-4b30-a74d-32f4894bbe96 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-unplugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c09e5b31-a64b-4264-87d4-62c9249421af req-e21c3e17-5d2a-4b30-a74d-32f4894bbe96 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c09e5b31-a64b-4264-87d4-62c9249421af req-e21c3e17-5d2a-4b30-a74d-32f4894bbe96 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c09e5b31-a64b-4264-87d4-62c9249421af req-e21c3e17-5d2a-4b30-a74d-32f4894bbe96 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-c09e5b31-a64b-4264-87d4-62c9249421af req-e21c3e17-5d2a-4b30-a74d-32f4894bbe96 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-unplugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-c09e5b31-a64b-4264-87d4-62c9249421af req-e21c3e17-5d2a-4b30-a74d-32f4894bbe96 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-unplugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Instance destroyed successfully.
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'resources' on Instance uuid 6515b699-7198-4fca-b3f5-30eeb70bf3b1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419978631',display_name='tempest-ServerActionsTestOtherA-server-419978631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419978631',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-y0t2dcnt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:04:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=6515b699-7198-4fca-b3f5-30eeb70bf3b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "address": "fa:16:3e:9e:70:a5", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc7961c-9c", "ovs_interfaceid": "3fc7961c-9c92-47fe-bc61-522c26fb2e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_vif [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fc7961c-9c, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:06:55 user nova-compute[72780]: INFO os_vif [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=3fc7961c-9c92-47fe-bc61-522c26fb2e70,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc7961c-9c')
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfwzxSQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:06:55 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1220d7a-b648-4484-8f08-32a07b145463]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c20935-0b8a-4818-910a-ea164f1185fd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:55 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:55 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:55 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:06:55 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:06:55 user nova-compute[72780]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 (non-flash)
Aug 09 01:06:55 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:06:55 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:06:55 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac07c1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03bf0f-9b72-4ff8-997f-071da70bd0d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce9688-ad6d-42f5-a6c5-28d04002edcf]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[723cce22-b2e9-42d5-802f-1835a60f3ec1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1109a4fb-40c8-40c5-ae8e-2c3c8e2b9174]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d1094-287f-4254-8e3b-89d3f70cb8fb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62902377-b92d-4173-b015-4614e17f2317]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260]
Aug 09 01:06:55 user nova-compute[72780]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04, portal: 172.16.0.220,3260] successful.
Aug 09 01:06:55 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb88762-8761-4912-939a-fced2821c8c6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] <== disconnect_volume: return (370ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:06:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Deleting instance files /opt/stack/data/nova/instances/6515b699-7198-4fca-b3f5-30eeb70bf3b1_del
Aug 09 01:06:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Deletion of /opt/stack/data/nova/instances/6515b699-7198-4fca-b3f5-30eeb70bf3b1_del complete
Aug 09 01:06:55 user nova-compute[72780]: INFO nova.compute.manager [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Took 1.45 seconds to destroy the instance on the hypervisor.
Aug 09 01:06:55 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:06:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:06:57 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:06:57 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Took 1.14 seconds to deallocate network for instance.
Aug 09 01:06:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-97d15603-c874-4e09-b8f3-64c759bc69df req-00113a7c-aa6a-4ad9-8fff-443fb9d1daa3 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-97d15603-c874-4e09-b8f3-64c759bc69df req-00113a7c-aa6a-4ad9-8fff-443fb9d1daa3 service nova] Acquiring lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-97d15603-c874-4e09-b8f3-64c759bc69df req-00113a7c-aa6a-4ad9-8fff-443fb9d1daa3 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-97d15603-c874-4e09-b8f3-64c759bc69df req-00113a7c-aa6a-4ad9-8fff-443fb9d1daa3 service nova] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-97d15603-c874-4e09-b8f3-64c759bc69df req-00113a7c-aa6a-4ad9-8fff-443fb9d1daa3 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] No waiting events found dispatching network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:06:57 user nova-compute[72780]: WARNING nova.compute.manager [req-97d15603-c874-4e09-b8f3-64c759bc69df req-00113a7c-aa6a-4ad9-8fff-443fb9d1daa3 service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received unexpected event network-vif-plugged-3fc7961c-9c92-47fe-bc61-522c26fb2e70 for instance with vm_state active and task_state deleting.
Aug 09 01:06:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-225c67ce-1d4b-4d56-ad80-845858ffabba req-9ab1e842-96ae-489f-87dc-69716276315e service nova] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Received event network-vif-deleted-3fc7961c-9c92-47fe-bc61-522c26fb2e70 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:06:57 user nova-compute[72780]: INFO nova.compute.manager [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Took 0.88 seconds to detach 1 volumes for instance.
Aug 09 01:06:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Deleting volume: ac7fbb21-ba2f-469c-bfbd-60f69ac5af04 {{(pid=72780) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 01:06:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:06:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:06:58 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:06:58 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:06:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:06:58 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Deleted allocations for instance 6515b699-7198-4fca-b3f5-30eeb70bf3b1
Aug 09 01:06:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1cdcb39d-53e2-48a8-9481-ad8201bea4ba tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "6515b699-7198-4fca-b3f5-30eeb70bf3b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.177s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:10 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543215.3809247, 6515b699-7198-4fca-b3f5-30eeb70bf3b1 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:07:10 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] VM Stopped (Lifecycle Event)
Aug 09 01:07:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-37c17c76-f67a-4d48-825d-6ff2cf6cab75 None None] [instance: 6515b699-7198-4fca-b3f5-30eeb70bf3b1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:07:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:07:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:07:13 user nova-compute[72780]: INFO nova.compute.claims [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Claim successful on node user
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:07:14 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.policy [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a84b071f368f433fb376d787d1abbca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bebae52273848ebaa7ef0260df630d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:07:14 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Creating image(s)
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "/opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "/opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "/opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk 1073741824" returned: 0 in 0.071s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Successfully created port: 2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Cannot resize image /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG nova.objects.instance [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'migration_context' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Ensure instance console log exists: /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Successfully updated port: 2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquired lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-changed-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Refreshing instance network info cache due to event network-changed-2e22afce-83a2-4c64-98ea-95591cc04ad0. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] Acquiring lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.neutron [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating instance_info_cache with network_info: [{"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Releasing lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Instance network_info: |[{"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] Acquired lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.neutron [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Refreshing network info cache for port 2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Start _get_guest_xml network_info=[{"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:07:16 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:07:16 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1407073766',display_name='tempest-TestServerVolumeAttachmentScenario-server-1407073766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1407073766',id=34,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBTDG8yRM2PHcgNROrqTwszy3OYiXe9J3BxzWvtYc9eHHNfcNAMExLfE41MeuUWEWR4ht9P+idRq+YDFNvb41pvaZKudtec+tMndg1T2Jd8lo3DnGQyRiA35JfH/k8vMw==',key_name='tempest-keypair-23255615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bebae52273848ebaa7ef0260df630d7',ramdisk_id='',reservation_id='r-0a3qfum5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1362148067',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1362148067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a84b071f368f433fb376d787d1abbca4',uuid=006a70f2-b9aa-47eb-b885-8f9e68926cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Converting VIF {"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'pci_devices' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:07:16 user nova-compute[72780]:   <uuid>006a70f2-b9aa-47eb-b885-8f9e68926cca</uuid>
Aug 09 01:07:16 user nova-compute[72780]:   <name>instance-00000022</name>
Aug 09 01:07:16 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:07:16 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:07:16 user nova-compute[72780]:   <metadata>
Aug 09 01:07:16 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:07:16 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:07:16 user nova-compute[72780]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1407073766</nova:name>
Aug 09 01:07:16 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:07:16</nova:creationTime>
Aug 09 01:07:16 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:07:16 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:07:16 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:07:16 user nova-compute[72780]:       <nova:owner>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:user uuid="a84b071f368f433fb376d787d1abbca4">tempest-TestServerVolumeAttachmentScenario-1362148067-project-member</nova:user>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:project uuid="7bebae52273848ebaa7ef0260df630d7">tempest-TestServerVolumeAttachmentScenario-1362148067</nova:project>
Aug 09 01:07:16 user nova-compute[72780]:       </nova:owner>
Aug 09 01:07:16 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:07:16 user nova-compute[72780]:       <nova:ports>
Aug 09 01:07:16 user nova-compute[72780]:         <nova:port uuid="2e22afce-83a2-4c64-98ea-95591cc04ad0">
Aug 09 01:07:16 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 01:07:16 user nova-compute[72780]:         </nova:port>
Aug 09 01:07:16 user nova-compute[72780]:       </nova:ports>
Aug 09 01:07:16 user nova-compute[72780]:     </nova:instance>
Aug 09 01:07:16 user nova-compute[72780]:   </metadata>
Aug 09 01:07:16 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:07:16 user nova-compute[72780]:     <system>
Aug 09 01:07:16 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:07:16 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:07:16 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:07:16 user nova-compute[72780]:       <entry name="serial">006a70f2-b9aa-47eb-b885-8f9e68926cca</entry>
Aug 09 01:07:16 user nova-compute[72780]:       <entry name="uuid">006a70f2-b9aa-47eb-b885-8f9e68926cca</entry>
Aug 09 01:07:16 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:07:16 user nova-compute[72780]:     </system>
Aug 09 01:07:16 user nova-compute[72780]:   </sysinfo>
Aug 09 01:07:16 user nova-compute[72780]:   <os>
Aug 09 01:07:16 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:07:16 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:07:16 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:07:16 user nova-compute[72780]:   </os>
Aug 09 01:07:16 user nova-compute[72780]:   <features>
Aug 09 01:07:16 user nova-compute[72780]:     <acpi/>
Aug 09 01:07:16 user nova-compute[72780]:     <apic/>
Aug 09 01:07:16 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:07:16 user nova-compute[72780]:   </features>
Aug 09 01:07:16 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:07:16 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:07:16 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:07:16 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:07:16 user nova-compute[72780]:   </clock>
Aug 09 01:07:16 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:07:16 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:07:16 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:07:16 user nova-compute[72780]:   </cpu>
Aug 09 01:07:16 user nova-compute[72780]:   <devices>
Aug 09 01:07:16 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:07:16 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:07:16 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk"/>
Aug 09 01:07:16 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:07:16 user nova-compute[72780]:     </disk>
Aug 09 01:07:16 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:07:16 user nova-compute[72780]:       <mac address="fa:16:3e:af:a5:ac"/>
Aug 09 01:07:16 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:07:16 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:07:16 user nova-compute[72780]:       <target dev="tap2e22afce-83"/>
Aug 09 01:07:16 user nova-compute[72780]:     </interface>
Aug 09 01:07:16 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:07:16 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/console.log" append="off"/>
Aug 09 01:07:16 user nova-compute[72780]:     </serial>
Aug 09 01:07:16 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:07:16 user nova-compute[72780]:     <video>
Aug 09 01:07:16 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:07:16 user nova-compute[72780]:     </video>
Aug 09 01:07:16 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:07:16 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:07:16 user nova-compute[72780]:     </rng>
Aug 09 01:07:16 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:07:16 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:07:16 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:07:16 user nova-compute[72780]:     </memballoon>
Aug 09 01:07:16 user nova-compute[72780]:   </devices>
Aug 09 01:07:16 user nova-compute[72780]: </domain>
Aug 09 01:07:16 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1407073766',display_name='tempest-TestServerVolumeAttachmentScenario-server-1407073766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1407073766',id=34,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBTDG8yRM2PHcgNROrqTwszy3OYiXe9J3BxzWvtYc9eHHNfcNAMExLfE41MeuUWEWR4ht9P+idRq+YDFNvb41pvaZKudtec+tMndg1T2Jd8lo3DnGQyRiA35JfH/k8vMw==',key_name='tempest-keypair-23255615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bebae52273848ebaa7ef0260df630d7',ramdisk_id='',reservation_id='r-0a3qfum5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1362148067',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1362148067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a84b071f368f433fb376d787d1abbca4',uuid=006a70f2-b9aa-47eb-b885-8f9e68926cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Converting VIF {"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG os_vif [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e22afce-83, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e22afce-83, col_values=(('external_ids', {'iface-id': '2e22afce-83a2-4c64-98ea-95591cc04ad0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:a5:ac', 'vm-uuid': '006a70f2-b9aa-47eb-b885-8f9e68926cca'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:16 user nova-compute[72780]: INFO os_vif [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83')
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:07:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No VIF found with MAC fa:16:3e:af:a5:ac, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:17 user nova-compute[72780]: INFO nova.compute.manager [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Terminating instance
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updated VIF entry in instance network info cache for port 2e22afce-83a2-4c64-98ea-95591cc04ad0. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.network.neutron [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating instance_info_cache with network_info: [{"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-87e93964-6405-4e8d-9b9d-6173b39a2539 req-9b029849-ac15-48ef-9bdd-bd31cf02f9b1 service nova] Releasing lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-8db1e4c3-959f-40d8-9d4c-c2b981a731ed req-c877c561-c478-40da-87ed-46028164ac8b service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-vif-unplugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8db1e4c3-959f-40d8-9d4c-c2b981a731ed req-c877c561-c478-40da-87ed-46028164ac8b service nova] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8db1e4c3-959f-40d8-9d4c-c2b981a731ed req-c877c561-c478-40da-87ed-46028164ac8b service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8db1e4c3-959f-40d8-9d4c-c2b981a731ed req-c877c561-c478-40da-87ed-46028164ac8b service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-8db1e4c3-959f-40d8-9d4c-c2b981a731ed req-c877c561-c478-40da-87ed-46028164ac8b service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] No waiting events found dispatching network-vif-unplugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-8db1e4c3-959f-40d8-9d4c-c2b981a731ed req-c877c561-c478-40da-87ed-46028164ac8b service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-vif-unplugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:17 user nova-compute[72780]: INFO nova.compute.manager [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Terminating instance
Aug 09 01:07:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-vif-unplugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] No waiting events found dispatching network-vif-unplugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-vif-unplugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] Acquiring lock "3816591d-6b75-4813-8651-e012289c6a41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] Lock "3816591d-6b75-4813-8651-e012289c6a41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] No waiting events found dispatching network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:18 user nova-compute[72780]: WARNING nova.compute.manager [req-a6ce65b2-7984-4d56-bfb5-bd1c12fe1963 req-0de5596c-1195-4028-8a48-082aa4b72d27 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received unexpected event network-vif-plugged-38ba6593-b72d-4c53-8710-378da9c4c8f6 for instance with vm_state active and task_state deleting.
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Instance destroyed successfully.
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.objects.instance [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lazy-loading 'resources' on Instance uuid 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Instance destroyed successfully.
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'resources' on Instance uuid 3816591d-6b75-4813-8651-e012289c6a41 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624523165',display_name='tempest-ServersNegativeTestJSON-server-624523165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624523165',id=32,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bdc20d829ea406fa62810d68d336ee9',ramdisk_id='',reservation_id='r-zgfmj9mq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1030464829',owner_user_name='tempest-ServersNegativeTestJSON-1030464829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:05:35Z,user_data=None,user_id='3c08a00919854aaf9f20c0b66c54eb21',uuid=9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converting VIF {"id": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "address": "fa:16:3e:20:bc:48", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83fe230-9a", "ovs_interfaceid": "d83fe230-9ae8-40a1-a0e6-148e8c7b120b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG os_vif [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd83fe230-9a, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1140885323',display_name='tempest-AttachVolumeNegativeTest-server-1140885323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1140885323',id=30,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg23n/fYzeI1WYIY0ZxL0HweB9vc0HtWW8TZJTcEnbeDVN0AZTEz0oBZaebBR5oAo6bHJezYLULBXLiG6u+2SJR2Yv8FANAk1NY7QxeUDrblLfagow1fKgdggAOX7/jiA==',key_name='tempest-keypair-1347369617',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-9ujexpou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:04:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=3816591d-6b75-4813-8651-e012289c6a41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "address": "fa:16:3e:14:01:cd", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ba6593-b7", "ovs_interfaceid": "38ba6593-b72d-4c53-8710-378da9c4c8f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG os_vif [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38ba6593-b7, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:07:18 user nova-compute[72780]: INFO os_vif [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:48,bridge_name='br-int',has_traffic_filtering=True,id=d83fe230-9ae8-40a1-a0e6-148e8c7b120b,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83fe230-9a')
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Deleting instance files /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48_del
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Deletion of /opt/stack/data/nova/instances/9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48_del complete
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: INFO os_vif [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:01:cd,bridge_name='br-int',has_traffic_filtering=True,id=38ba6593-b72d-4c53-8710-378da9c4c8f6,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ba6593-b7')
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Deleting instance files /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41_del
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Deletion of /opt/stack/data/nova/instances/3816591d-6b75-4813-8651-e012289c6a41_del complete
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.compute.manager [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:07:18 user nova-compute[72780]: INFO nova.compute.manager [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 01:07:18 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-1e2637e2-9514-459f-ae52-7070dafad078 req-018972d4-a7d7-4f7c-9abe-602ac6a586bd service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e2637e2-9514-459f-ae52-7070dafad078 req-018972d4-a7d7-4f7c-9abe-602ac6a586bd service nova] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e2637e2-9514-459f-ae52-7070dafad078 req-018972d4-a7d7-4f7c-9abe-602ac6a586bd service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e2637e2-9514-459f-ae52-7070dafad078 req-018972d4-a7d7-4f7c-9abe-602ac6a586bd service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-1e2637e2-9514-459f-ae52-7070dafad078 req-018972d4-a7d7-4f7c-9abe-602ac6a586bd service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] No waiting events found dispatching network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:19 user nova-compute[72780]: WARNING nova.compute.manager [req-1e2637e2-9514-459f-ae52-7070dafad078 req-018972d4-a7d7-4f7c-9abe-602ac6a586bd service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received unexpected event network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 for instance with vm_state building and task_state spawning.
Aug 09 01:07:19 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:07:19 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Took 0.69 seconds to deallocate network for instance.
Aug 09 01:07:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:07:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:19 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Deleted allocations for instance 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.compute.manager [req-c1edd991-40bc-434f-8f15-a16a24f5da37 req-9afda752-adc7-45ec-9594-722092002160 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c1edd991-40bc-434f-8f15-a16a24f5da37 req-9afda752-adc7-45ec-9594-722092002160 service nova] Acquiring lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c1edd991-40bc-434f-8f15-a16a24f5da37 req-9afda752-adc7-45ec-9594-722092002160 service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c1edd991-40bc-434f-8f15-a16a24f5da37 req-9afda752-adc7-45ec-9594-722092002160 service nova] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.compute.manager [req-c1edd991-40bc-434f-8f15-a16a24f5da37 req-9afda752-adc7-45ec-9594-722092002160 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] No waiting events found dispatching network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:20 user nova-compute[72780]: WARNING nova.compute.manager [req-c1edd991-40bc-434f-8f15-a16a24f5da37 req-9afda752-adc7-45ec-9594-722092002160 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received unexpected event network-vif-plugged-d83fe230-9ae8-40a1-a0e6-148e8c7b120b for instance with vm_state deleted and task_state None.
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fcf25471-a605-4be9-9a20-7fe4653975a8 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.013s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.compute.manager [req-b085170d-4ff8-473d-b449-18b8e94fb6f2 req-66f3b785-6ab5-48de-bbe9-c766ac86de58 service nova] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Received event network-vif-deleted-d83fe230-9ae8-40a1-a0e6-148e8c7b120b {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:07:20 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Took 1.87 seconds to deallocate network for instance.
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:20 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Deleted allocations for instance 3816591d-6b75-4813-8651-e012289c6a41
Aug 09 01:07:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c96878fd-6ce8-4998-8287-2e96cf223adc tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "3816591d-6b75-4813-8651-e012289c6a41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.275s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543241.118371, 006a70f2-b9aa-47eb-b885-8f9e68926cca => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] VM Resumed (Lifecycle Event)
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Instance spawned successfully.
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543241.1200275, 006a70f2-b9aa-47eb-b885-8f9e68926cca => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] VM Started (Lifecycle Event)
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Took 6.73 seconds to spawn the instance on the hypervisor.
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-246a28dd-2438-4064-b8a4-a7b7adb4c1e7 req-7ebcb8b5-e18f-4364-beed-afb43d09584c service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-246a28dd-2438-4064-b8a4-a7b7adb4c1e7 req-7ebcb8b5-e18f-4364-beed-afb43d09584c service nova] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-246a28dd-2438-4064-b8a4-a7b7adb4c1e7 req-7ebcb8b5-e18f-4364-beed-afb43d09584c service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-246a28dd-2438-4064-b8a4-a7b7adb4c1e7 req-7ebcb8b5-e18f-4364-beed-afb43d09584c service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-246a28dd-2438-4064-b8a4-a7b7adb4c1e7 req-7ebcb8b5-e18f-4364-beed-afb43d09584c service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] No waiting events found dispatching network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:21 user nova-compute[72780]: WARNING nova.compute.manager [req-246a28dd-2438-4064-b8a4-a7b7adb4c1e7 req-7ebcb8b5-e18f-4364-beed-afb43d09584c service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received unexpected event network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 for instance with vm_state building and task_state spawning.
Aug 09 01:07:21 user nova-compute[72780]: INFO nova.compute.manager [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Took 7.54 seconds to build instance.
Aug 09 01:07:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-921d7afd-3126-4d28-9251-3bc1025ffbdf tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.643s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-86e1f881-5bff-41a7-8e6c-47c060fa114a req-ae3da8b2-933f-4d00-bc74-ecccffdcf2a6 service nova] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Received event network-vif-deleted-38ba6593-b72d-4c53-8710-378da9c4c8f6 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Updating instance_info_cache with network_info: [{"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-eef82018-54b7-471d-bee1-45bf26de56e1" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:07:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:07:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:07:26 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:07:28 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:07:28 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.049007415771484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c57928fc-08eb-407f-9e94-baf32611ac9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 82b3d395-7aec-4312-8bdd-50a84e8f3830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 006a70f2-b9aa-47eb-b885-8f9e68926cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:07:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:07:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:07:32 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543238.4199774, 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:07:33 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] VM Stopped (Lifecycle Event)
Aug 09 01:07:33 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543238.429238, 3816591d-6b75-4813-8651-e012289c6a41 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:07:33 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 3816591d-6b75-4813-8651-e012289c6a41] VM Stopped (Lifecycle Event)
Aug 09 01:07:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-eaaf7988-7b9a-40d4-8f5a-6870e5e91ad1 None None] [instance: 9e86f0b0-3e28-40db-8b16-8e7bd7fcdd48] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2cab6fb0-a7f1-4600-ac9d-189b5c9ca5cc None None] [instance: 3816591d-6b75-4813-8651-e012289c6a41] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:07:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:07:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:50 user nova-compute[72780]: INFO nova.compute.manager [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Terminating instance
Aug 09 01:07:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-34b428ed-0e57-4d43-b14b-65b158035ed3 req-43a93abf-0969-4724-81fa-9dfa3872c186 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-unplugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-34b428ed-0e57-4d43-b14b-65b158035ed3 req-43a93abf-0969-4724-81fa-9dfa3872c186 service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-34b428ed-0e57-4d43-b14b-65b158035ed3 req-43a93abf-0969-4724-81fa-9dfa3872c186 service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-34b428ed-0e57-4d43-b14b-65b158035ed3 req-43a93abf-0969-4724-81fa-9dfa3872c186 service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-34b428ed-0e57-4d43-b14b-65b158035ed3 req-43a93abf-0969-4724-81fa-9dfa3872c186 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-unplugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-34b428ed-0e57-4d43-b14b-65b158035ed3 req-43a93abf-0969-4724-81fa-9dfa3872c186 service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-unplugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:07:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Instance destroyed successfully.
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lazy-loading 'resources' on Instance uuid c57928fc-08eb-407f-9e94-baf32611ac9e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T00:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-699159265',display_name='tempest-ServerActionsTestOtherA-server-2000524521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-699159265',id=2,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpx+OgIwftJ62DnjGkLb6D4hW/mVssoaPkl0rWKN4NcHW2sXbhqgNZ2cFpUYzt8nIiT5WKmshoIECT/77FdKxp07rt/EZMm3yWdSao8n65W3dP3jpYYQE8r9qvLBl00A==',key_name='tempest-keypair-1056423924',keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eb0278ced1640e9a1ab66e5cfcafc8f',ramdisk_id='',reservation_id='r-2qcxlys7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1294078380',owner_user_name='tempest-ServerActionsTestOtherA-1294078380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8412204a685048a6a787793a7266f085',uuid=c57928fc-08eb-407f-9e94-baf32611ac9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converting VIF {"id": "94a22dc3-1499-42f5-8229-ce152758ea73", "address": "fa:16:3e:7b:29:0d", "network": {"id": "640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1944907576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eb0278ced1640e9a1ab66e5cfcafc8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a22dc3-14", "ovs_interfaceid": "94a22dc3-1499-42f5-8229-ce152758ea73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG os_vif [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a22dc3-14, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:07:51 user nova-compute[72780]: INFO os_vif [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:29:0d,bridge_name='br-int',has_traffic_filtering=True,id=94a22dc3-1499-42f5-8229-ce152758ea73,network=Network(640bf2c7-225b-4a5c-bab6-cbcd2d9dc17d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a22dc3-14')
Aug 09 01:07:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Deleting instance files /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e_del
Aug 09 01:07:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Deletion of /opt/stack/data/nova/instances/c57928fc-08eb-407f-9e94-baf32611ac9e_del complete
Aug 09 01:07:51 user nova-compute[72780]: INFO nova.compute.manager [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 01:07:51 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:07:51 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:07:52 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:07:52 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Took 0.50 seconds to deallocate network for instance.
Aug 09 01:07:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:52 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:07:52 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:07:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:52 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Deleted allocations for instance c57928fc-08eb-407f-9e94-baf32611ac9e
Aug 09 01:07:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-037ea2f4-368c-4d1d-a3d0-3bf5ea964071 tempest-ServerActionsTestOtherA-1294078380 tempest-ServerActionsTestOtherA-1294078380-project-member] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] Acquiring lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:07:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:07:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] Lock "c57928fc-08eb-407f-9e94-baf32611ac9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:07:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] No waiting events found dispatching network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:07:53 user nova-compute[72780]: WARNING nova.compute.manager [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received unexpected event network-vif-plugged-94a22dc3-1499-42f5-8229-ce152758ea73 for instance with vm_state deleted and task_state None.
Aug 09 01:07:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-0eed4b2d-f738-4a19-8535-f4d1bbb4d693 req-7f9ca6a8-2d8e-4c85-9fda-4cf1172f4b2b service nova] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Received event network-vif-deleted-94a22dc3-1499-42f5-8229-ce152758ea73 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:07:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-changed-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Refreshing instance network info cache due to event network-changed-072b2587-415f-4c16-b677-30d737fb021d. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] Acquiring lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] Acquired lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Refreshing network info cache for port 072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid eef82018-54b7-471d-bee1-45bf26de56e1 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 82b3d395-7aec-4312-8bdd-50a84e8f3830 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "eef82018-54b7-471d-bee1-45bf26de56e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "eef82018-54b7-471d-bee1-45bf26de56e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updated VIF entry in instance network info cache for port 072b2587-415f-4c16-b677-30d737fb021d. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:08:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updating instance_info_cache with network_info: [{"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1e59a60f-170b-4734-8f7a-9f505ac84540 req-6314d982-82b8-4704-8b27-27173d4db65c service nova] Releasing lock "refresh_cache-82b3d395-7aec-4312-8bdd-50a84e8f3830" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:06 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543271.5299425, c57928fc-08eb-407f-9e94-baf32611ac9e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:06 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] VM Stopped (Lifecycle Event)
Aug 09 01:08:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6693d1c5-b45e-4e6b-81bf-62e062e46e87 None None] [instance: c57928fc-08eb-407f-9e94-baf32611ac9e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:08:11 user nova-compute[72780]: INFO nova.compute.claims [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Claim successful on node user
Aug 09 01:08:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:08:11 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:08:11 user nova-compute[72780]: INFO nova.compute.claims [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Claim successful on node user
Aug 09 01:08:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:08:12 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Creating image(s)
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "/opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.policy [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0456a39aaa64bdca5df6a3b67ea9d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0bd68653554fafa823eacae86e21a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk 1073741824" returned: 0 in 0.061s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:12 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:08:12 user nova-compute[72780]: INFO nova.virt.block_device [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Booting with volume snapshot 920f6f1a-e513-4f1b-9234-87d6540be902 at /dev/vda
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'migration_context' on Instance uuid dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.policy [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54101aceab04126ba338c9965790cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9933f68af5d6419e92195eb3b49687a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:08:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Successfully created port: 569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Successfully created port: dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Successfully updated port: 569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquired lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-changed-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Refreshing instance network info cache due to event network-changed-569811ea-ca1d-427f-be17-e7a8b8d47ba3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] Acquiring lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updating instance_info_cache with network_info: [{"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Releasing lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Instance network_info: |[{"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] Acquired lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Refreshing network info cache for port 569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Start _get_guest_xml network_info=[{"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:08:14 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:14 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1811724090',display_name='tempest-AttachVolumeNegativeTest-server-1811724090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1811724090',id=35,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINVTik08fHgoR3kDaD3cbhfYahjAPXn7eYVGG92l+pHUIMtLMmRLGMANSVcxwkENZpdOefZXe7t3TplP8gN5pyMKvPvWCRhFvT2/aOj5WItQqzoVWzf1Ghck/PX64+jMg==',key_name='tempest-keypair-1501201909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-8ofwyhko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=dcd7e878-0475-4004-8a45-c15f405e0883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:08:14 user nova-compute[72780]:   <uuid>dcd7e878-0475-4004-8a45-c15f405e0883</uuid>
Aug 09 01:08:14 user nova-compute[72780]:   <name>instance-00000023</name>
Aug 09 01:08:14 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:08:14 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:08:14 user nova-compute[72780]:   <metadata>
Aug 09 01:08:14 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:08:14 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:08:14 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1811724090</nova:name>
Aug 09 01:08:14 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:08:14</nova:creationTime>
Aug 09 01:08:14 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:08:14 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:08:14 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:08:14 user nova-compute[72780]:       <nova:owner>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:user uuid="f0456a39aaa64bdca5df6a3b67ea9d68">tempest-AttachVolumeNegativeTest-1434038909-project-member</nova:user>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:project uuid="dd0bd68653554fafa823eacae86e21a0">tempest-AttachVolumeNegativeTest-1434038909</nova:project>
Aug 09 01:08:14 user nova-compute[72780]:       </nova:owner>
Aug 09 01:08:14 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:08:14 user nova-compute[72780]:       <nova:ports>
Aug 09 01:08:14 user nova-compute[72780]:         <nova:port uuid="569811ea-ca1d-427f-be17-e7a8b8d47ba3">
Aug 09 01:08:14 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 01:08:14 user nova-compute[72780]:         </nova:port>
Aug 09 01:08:14 user nova-compute[72780]:       </nova:ports>
Aug 09 01:08:14 user nova-compute[72780]:     </nova:instance>
Aug 09 01:08:14 user nova-compute[72780]:   </metadata>
Aug 09 01:08:14 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:08:14 user nova-compute[72780]:     <system>
Aug 09 01:08:14 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:08:14 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:08:14 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:08:14 user nova-compute[72780]:       <entry name="serial">dcd7e878-0475-4004-8a45-c15f405e0883</entry>
Aug 09 01:08:14 user nova-compute[72780]:       <entry name="uuid">dcd7e878-0475-4004-8a45-c15f405e0883</entry>
Aug 09 01:08:14 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:08:14 user nova-compute[72780]:     </system>
Aug 09 01:08:14 user nova-compute[72780]:   </sysinfo>
Aug 09 01:08:14 user nova-compute[72780]:   <os>
Aug 09 01:08:14 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:08:14 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:08:14 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:08:14 user nova-compute[72780]:   </os>
Aug 09 01:08:14 user nova-compute[72780]:   <features>
Aug 09 01:08:14 user nova-compute[72780]:     <acpi/>
Aug 09 01:08:14 user nova-compute[72780]:     <apic/>
Aug 09 01:08:14 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:08:14 user nova-compute[72780]:   </features>
Aug 09 01:08:14 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:08:14 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:08:14 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:08:14 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:08:14 user nova-compute[72780]:   </clock>
Aug 09 01:08:14 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:08:14 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:08:14 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:08:14 user nova-compute[72780]:   </cpu>
Aug 09 01:08:14 user nova-compute[72780]:   <devices>
Aug 09 01:08:14 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:08:14 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:08:14 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk"/>
Aug 09 01:08:14 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:08:14 user nova-compute[72780]:     </disk>
Aug 09 01:08:14 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:08:14 user nova-compute[72780]:       <mac address="fa:16:3e:2a:7d:dc"/>
Aug 09 01:08:14 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:08:14 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:08:14 user nova-compute[72780]:       <target dev="tap569811ea-ca"/>
Aug 09 01:08:14 user nova-compute[72780]:     </interface>
Aug 09 01:08:14 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:08:14 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/console.log" append="off"/>
Aug 09 01:08:14 user nova-compute[72780]:     </serial>
Aug 09 01:08:14 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:08:14 user nova-compute[72780]:     <video>
Aug 09 01:08:14 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:08:14 user nova-compute[72780]:     </video>
Aug 09 01:08:14 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:08:14 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:08:14 user nova-compute[72780]:     </rng>
Aug 09 01:08:14 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:08:14 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:08:14 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:08:14 user nova-compute[72780]:     </memballoon>
Aug 09 01:08:14 user nova-compute[72780]:   </devices>
Aug 09 01:08:14 user nova-compute[72780]: </domain>
Aug 09 01:08:14 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1811724090',display_name='tempest-AttachVolumeNegativeTest-server-1811724090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1811724090',id=35,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINVTik08fHgoR3kDaD3cbhfYahjAPXn7eYVGG92l+pHUIMtLMmRLGMANSVcxwkENZpdOefZXe7t3TplP8gN5pyMKvPvWCRhFvT2/aOj5WItQqzoVWzf1Ghck/PX64+jMg==',key_name='tempest-keypair-1501201909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-8ofwyhko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=dcd7e878-0475-4004-8a45-c15f405e0883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG os_vif [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap569811ea-ca, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap569811ea-ca, col_values=(('external_ids', {'iface-id': '569811ea-ca1d-427f-be17-e7a8b8d47ba3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:7d:dc', 'vm-uuid': 'dcd7e878-0475-4004-8a45-c15f405e0883'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:14 user nova-compute[72780]: INFO os_vif [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca')
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:2a:7d:dc, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updated VIF entry in instance network info cache for port 569811ea-ca1d-427f-be17-e7a8b8d47ba3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updating instance_info_cache with network_info: [{"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-14c54120-32c5-4e67-87d1-5ad703df4d82 req-05decbd5-54a2-495b-a049-44133b2720c0 service nova] Releasing lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Successfully updated port: dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquired lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-changed-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Refreshing instance network info cache due to event network-changed-dd27cae1-6be6-4fbb-96d4-9171c7f5643f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] Acquiring lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updating instance_info_cache with network_info: [{"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Releasing lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Instance network_info: |[{"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] Acquired lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Refreshing network info cache for port dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updated VIF entry in instance network info cache for port dd27cae1-6be6-4fbb-96d4-9171c7f5643f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updating instance_info_cache with network_info: [{"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c5fa5d92-53d7-4018-a5e9-3b0e62fdcfef req-14fa37c8-55c2-41d1-a388-dfcc9fde74c5 service nova] Releasing lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-27ea4284-fd74-46c2-b636-74422a817289 req-9ab760c3-170e-49e0-8592-1711148399e0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27ea4284-fd74-46c2-b636-74422a817289 req-9ab760c3-170e-49e0-8592-1711148399e0 service nova] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27ea4284-fd74-46c2-b636-74422a817289 req-9ab760c3-170e-49e0-8592-1711148399e0 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27ea4284-fd74-46c2-b636-74422a817289 req-9ab760c3-170e-49e0-8592-1711148399e0 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-27ea4284-fd74-46c2-b636-74422a817289 req-9ab760c3-170e-49e0-8592-1711148399e0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] No waiting events found dispatching network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:15 user nova-compute[72780]: WARNING nova.compute.manager [req-27ea4284-fd74-46c2-b636-74422a817289 req-9ab760c3-170e-49e0-8592-1711148399e0 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received unexpected event network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 for instance with vm_state building and task_state spawning.
Aug 09 01:08:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543297.664317, dcd7e878-0475-4004-8a45-c15f405e0883 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] VM Resumed (Lifecycle Event)
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Instance spawned successfully.
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543297.6686895, dcd7e878-0475-4004-8a45-c15f405e0883 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] VM Started (Lifecycle Event)
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:17 user nova-compute[72780]: INFO nova.compute.manager [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Took 6.38 seconds to build instance.
Aug 09 01:08:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8bb9bf4b-3167-419e-a516-49ae9b9f406c tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.474s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-8985078c-086f-4cfe-8d53-59128ea1ff49 req-6f8b65b5-8d2e-4a92-a0a1-547fb58b59f7 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8985078c-086f-4cfe-8d53-59128ea1ff49 req-6f8b65b5-8d2e-4a92-a0a1-547fb58b59f7 service nova] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8985078c-086f-4cfe-8d53-59128ea1ff49 req-6f8b65b5-8d2e-4a92-a0a1-547fb58b59f7 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8985078c-086f-4cfe-8d53-59128ea1ff49 req-6f8b65b5-8d2e-4a92-a0a1-547fb58b59f7 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-8985078c-086f-4cfe-8d53-59128ea1ff49 req-6f8b65b5-8d2e-4a92-a0a1-547fb58b59f7 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] No waiting events found dispatching network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:17 user nova-compute[72780]: WARNING nova.compute.manager [req-8985078c-086f-4cfe-8d53-59128ea1ff49 req-6f8b65b5-8d2e-4a92-a0a1-547fb58b59f7 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received unexpected event network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 for instance with vm_state active and task_state None.
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG os_brick.utils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8271be9e-1885-43ff-89ce-107aca7eba7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2fca9-bf03-478a-9692-0fea7602f9ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db045ab-0fc4-4c95-be8f-a4767e3c8a02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb2606c-b7f8-41fe-905d-859ab039cb6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:08:18 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:08:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9755d-264a-4ba1-9e21-cca294728f1e]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG os_brick.utils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:08:18 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updating existing volume attachment record: e6fbe18e-eee4-4bec-bf99-37c01ce99790 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:08:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.objects.instance [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'flavor' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:23 user nova-compute[72780]: INFO nova.compute.manager [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Attaching volume b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 to /dev/vdb
Aug 09 01:08:23 user nova-compute[72780]: DEBUG os_brick.utils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[08543cd3-ebc8-42f6-b120-1049f2f8f7ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62762c8-cb7b-41c3-ac3e-f9cb5fa8771e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7413b1b-054d-4160-a924-b7d76aad991f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5924dff2-6997-44c0-87fc-8a86dc3361ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating instance_info_cache with network_info: [{"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:08:23 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb2d63-aa2d-4fb8-899c-fed0ca986bd6]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG os_brick.utils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating existing volume attachment record: 8a3e53f8-8a4c-4572-be89-d51f50e4b8e4 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:08:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:08:27 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Creating image(s)
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Ensure instance console log exists: /opt/stack/data/nova/instances/eba7383a-8b23-4c07-a628-8a5db60b2e20/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Start _get_guest_xml network_info=[{"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T01:08:04Z,direct_url=<?>,disk_format='qcow2',id=cbdfc500-8098-48dd-9c13-edea74cd5398,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-433121721',owner='9933f68af5d6419e92195eb3b49687a8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T01:08:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrcbzAZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eba7383a-8b23-4c07-a628-8a5db60b2e20', 'attached_at': '', 'detached_at': '', 'volume_id': '26733be9-ff1e-4e56-8daa-8171528168b4', 'serial': '26733be9-ff1e-4e56-8daa-8171528168b4'}, 'disk_bus': 'virtio', 'attachment_id': 'e6fbe18e-eee4-4bec-bf99-37c01ce99790', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:08:27 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:27 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T01:08:04Z,direct_url=<?>,disk_format='qcow2',id=cbdfc500-8098-48dd-9c13-edea74cd5398,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-433121721',owner='9933f68af5d6419e92195eb3b49687a8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T01:08:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrcbzAZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:08:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:27 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfef665-98f6-4a07-b4e7-0dade4b67557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:08:27 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[17803f53-78bb-459b-bf09-bc15f8a3ab1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4] added
Aug 09 01:08:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[827779be-abd3-4c89-bcc6-b419fb51da78]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[380368e4-e551-4857-8dd3-2e0481387a6b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrcbzAZa {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrcbzAZa" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5c87d7-fe85-4f37-9bde-561629cc3097]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrcbzAZa'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f26d0-da64-46d9-8c5f-11d7c658722a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae1653-7e3c-446b-a44f-76a8a0c5aa8e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea29e2a-14eb-4591-87a4-d1b42caa77bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260]
Aug 09 01:08:27 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260] successful.
Aug 09 01:08:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae9b9a-aa02-42c8-9d9a-c30ff0fa6d3e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[feca8412-6fa3-4faf-b8a8-69dfee413078]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:27 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[19075bfb-1fec-43a4-a0b9-fa82c700bc5a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrcbzAZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26630623737383766', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630623737383766', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1047171170',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1047171170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1047171170',id=36,image_ref='cbdfc500-8098-48dd-9c13-edea74cd5398',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKgAV/KYQjGcZl7zIECvbDog15N3h5ujgQG6YJmEUU/usp1r+f/t0LlNt/l6TUs8qoJIMVwZE1wur4zqxN6H8ClvWDDgZyBja2paap+UP9h2aPO10Id637QKgvAIkRwcQ==',key_name='tempest-keypair-986777708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-khrqy83c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1708118170',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54101aceab04126ba338c9965790cf3',uuid=eba7383a-8b23-4c07-a628-8a5db60b2e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'pci_devices' on Instance uuid eba7383a-8b23-4c07-a628-8a5db60b2e20 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:08:28 user nova-compute[72780]:   <uuid>eba7383a-8b23-4c07-a628-8a5db60b2e20</uuid>
Aug 09 01:08:28 user nova-compute[72780]:   <name>instance-00000024</name>
Aug 09 01:08:28 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:08:28 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:08:28 user nova-compute[72780]:   <metadata>
Aug 09 01:08:28 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:08:28 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:08:28 user nova-compute[72780]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1047171170</nova:name>
Aug 09 01:08:28 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:08:27</nova:creationTime>
Aug 09 01:08:28 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:08:28 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:08:28 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:08:28 user nova-compute[72780]:       <nova:owner>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:user uuid="d54101aceab04126ba338c9965790cf3">tempest-TestVolumeBootPattern-1708118170-project-member</nova:user>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:project uuid="9933f68af5d6419e92195eb3b49687a8">tempest-TestVolumeBootPattern-1708118170</nova:project>
Aug 09 01:08:28 user nova-compute[72780]:       </nova:owner>
Aug 09 01:08:28 user nova-compute[72780]:       <nova:root type="image" uuid="cbdfc500-8098-48dd-9c13-edea74cd5398"/>
Aug 09 01:08:28 user nova-compute[72780]:       <nova:ports>
Aug 09 01:08:28 user nova-compute[72780]:         <nova:port uuid="dd27cae1-6be6-4fbb-96d4-9171c7f5643f">
Aug 09 01:08:28 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 01:08:28 user nova-compute[72780]:         </nova:port>
Aug 09 01:08:28 user nova-compute[72780]:       </nova:ports>
Aug 09 01:08:28 user nova-compute[72780]:     </nova:instance>
Aug 09 01:08:28 user nova-compute[72780]:   </metadata>
Aug 09 01:08:28 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:08:28 user nova-compute[72780]:     <system>
Aug 09 01:08:28 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:08:28 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:08:28 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:08:28 user nova-compute[72780]:       <entry name="serial">eba7383a-8b23-4c07-a628-8a5db60b2e20</entry>
Aug 09 01:08:28 user nova-compute[72780]:       <entry name="uuid">eba7383a-8b23-4c07-a628-8a5db60b2e20</entry>
Aug 09 01:08:28 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:08:28 user nova-compute[72780]:     </system>
Aug 09 01:08:28 user nova-compute[72780]:   </sysinfo>
Aug 09 01:08:28 user nova-compute[72780]:   <os>
Aug 09 01:08:28 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:08:28 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:08:28 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:08:28 user nova-compute[72780]:   </os>
Aug 09 01:08:28 user nova-compute[72780]:   <features>
Aug 09 01:08:28 user nova-compute[72780]:     <acpi/>
Aug 09 01:08:28 user nova-compute[72780]:     <apic/>
Aug 09 01:08:28 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:08:28 user nova-compute[72780]:   </features>
Aug 09 01:08:28 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:08:28 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:08:28 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:08:28 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:08:28 user nova-compute[72780]:   </clock>
Aug 09 01:08:28 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:08:28 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:08:28 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:08:28 user nova-compute[72780]:   </cpu>
Aug 09 01:08:28 user nova-compute[72780]:   <devices>
Aug 09 01:08:28 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:08:28 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:08:28 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 01:08:28 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:08:28 user nova-compute[72780]:       <serial>26733be9-ff1e-4e56-8daa-8171528168b4</serial>
Aug 09 01:08:28 user nova-compute[72780]:     </disk>
Aug 09 01:08:28 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:08:28 user nova-compute[72780]:       <mac address="fa:16:3e:95:89:de"/>
Aug 09 01:08:28 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:08:28 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:08:28 user nova-compute[72780]:       <target dev="tapdd27cae1-6b"/>
Aug 09 01:08:28 user nova-compute[72780]:     </interface>
Aug 09 01:08:28 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:08:28 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/eba7383a-8b23-4c07-a628-8a5db60b2e20/console.log" append="off"/>
Aug 09 01:08:28 user nova-compute[72780]:     </serial>
Aug 09 01:08:28 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:08:28 user nova-compute[72780]:     <video>
Aug 09 01:08:28 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:08:28 user nova-compute[72780]:     </video>
Aug 09 01:08:28 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:08:28 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:08:28 user nova-compute[72780]:     </rng>
Aug 09 01:08:28 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:08:28 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:08:28 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:08:28 user nova-compute[72780]:     </memballoon>
Aug 09 01:08:28 user nova-compute[72780]:   </devices>
Aug 09 01:08:28 user nova-compute[72780]: </domain>
Aug 09 01:08:28 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1047171170',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1047171170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1047171170',id=36,image_ref='cbdfc500-8098-48dd-9c13-edea74cd5398',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKgAV/KYQjGcZl7zIECvbDog15N3h5ujgQG6YJmEUU/usp1r+f/t0LlNt/l6TUs8qoJIMVwZE1wur4zqxN6H8ClvWDDgZyBja2paap+UP9h2aPO10Id637QKgvAIkRwcQ==',key_name='tempest-keypair-986777708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-khrqy83c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1708118170',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54101aceab04126ba338c9965790cf3',uuid=eba7383a-8b23-4c07-a628-8a5db60b2e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG os_vif [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:08:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd27cae1-6b, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd27cae1-6b, col_values=(('external_ids', {'iface-id': 'dd27cae1-6be6-4fbb-96d4-9171c7f5643f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:89:de', 'vm-uuid': 'eba7383a-8b23-4c07-a628-8a5db60b2e20'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:29 user nova-compute[72780]: INFO os_vif [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b')
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No VIF found with MAC fa:16:3e:95:89:de, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543312.584233, eba7383a-8b23-4c07-a628-8a5db60b2e20 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] VM Resumed (Lifecycle Event)
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-4e55b9d4-d323-4039-9942-3c8b3bee17d0 req-71fb7de1-062a-45bf-b99a-4c0ae81dc010 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4e55b9d4-d323-4039-9942-3c8b3bee17d0 req-71fb7de1-062a-45bf-b99a-4c0ae81dc010 service nova] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4e55b9d4-d323-4039-9942-3c8b3bee17d0 req-71fb7de1-062a-45bf-b99a-4c0ae81dc010 service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4e55b9d4-d323-4039-9942-3c8b3bee17d0 req-71fb7de1-062a-45bf-b99a-4c0ae81dc010 service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-4e55b9d4-d323-4039-9942-3c8b3bee17d0 req-71fb7de1-062a-45bf-b99a-4c0ae81dc010 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] No waiting events found dispatching network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:32 user nova-compute[72780]: WARNING nova.compute.manager [req-4e55b9d4-d323-4039-9942-3c8b3bee17d0 req-71fb7de1-062a-45bf-b99a-4c0ae81dc010 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received unexpected event network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f for instance with vm_state building and task_state spawning.
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-1643db77-4650-4381-9259-d01c1cb4bffe req-23c890b9-daeb-419f-97ac-263e9feacc37 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1643db77-4650-4381-9259-d01c1cb4bffe req-23c890b9-daeb-419f-97ac-263e9feacc37 service nova] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1643db77-4650-4381-9259-d01c1cb4bffe req-23c890b9-daeb-419f-97ac-263e9feacc37 service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1643db77-4650-4381-9259-d01c1cb4bffe req-23c890b9-daeb-419f-97ac-263e9feacc37 service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-1643db77-4650-4381-9259-d01c1cb4bffe req-23c890b9-daeb-419f-97ac-263e9feacc37 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] No waiting events found dispatching network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:32 user nova-compute[72780]: WARNING nova.compute.manager [req-1643db77-4650-4381-9259-d01c1cb4bffe req-23c890b9-daeb-419f-97ac-263e9feacc37 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received unexpected event network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f for instance with vm_state building and task_state spawning.
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:08:32 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:32 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=25.045814514160156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Instance spawned successfully.
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543312.5847697, eba7383a-8b23-4c07-a628-8a5db60b2e20 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] VM Started (Lifecycle Event)
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.compute.manager [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Terminating instance
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:08:32 user nova-compute[72780]: INFO nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'galzmefW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:08:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:32 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0fcfb9-aecc-474a-8a8b-80d16d038d8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:08:32 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f456a141-ed33-4fe2-8396-b3eb8c2988cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953] added
Aug 09 01:08:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: INFO nova.compute.manager [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Took 21.05 seconds to build instance.
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7415031c-64af-40b1-941a-0b5ef6764cf5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8a3242de-7156-4900-90e6-64276ec41843 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.154s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed4d38-78df-4705-a870-659aada01629]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v galzmefW {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v galzmefW" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f9d06a-92ff-4b7b-8a4f-48031cc9c198]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'galzmefW'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eef82018-54b7-471d-bee1-45bf26de56e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 82b3d395-7aec-4312-8bdd-50a84e8f3830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 006a70f2-b9aa-47eb-b885-8f9e68926cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance dcd7e878-0475-4004-8a45-c15f405e0883 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eba7383a-8b23-4c07-a628-8a5db60b2e20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149d763-e62b-4fa5-b3a8-24120d451718]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e849b0-c690-49ea-a6dc-b558890001ba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-1a34742f-fa80-4923-8f01-d28a2e5bbe37 req-e1127f98-2bd4-418b-89ee-6dfc42944ea9 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1a34742f-fa80-4923-8f01-d28a2e5bbe37 req-e1127f98-2bd4-418b-89ee-6dfc42944ea9 service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1a34742f-fa80-4923-8f01-d28a2e5bbe37 req-e1127f98-2bd4-418b-89ee-6dfc42944ea9 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1a34742f-fa80-4923-8f01-d28a2e5bbe37 req-e1127f98-2bd4-418b-89ee-6dfc42944ea9 service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-1a34742f-fa80-4923-8f01-d28a2e5bbe37 req-e1127f98-2bd4-418b-89ee-6dfc42944ea9 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-1a34742f-fa80-4923-8f01-d28a2e5bbe37 req-e1127f98-2bd4-418b-89ee-6dfc42944ea9 service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-unplugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca439c3d-77b8-4820-9780-be69c224c796]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260]
Aug 09 01:08:33 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260] successful.
Aug 09 01:08:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a7ff0e-040b-43a8-b1ec-fd3f018db936]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[869bde26-b4e3-43f4-bf88-5d829b0ee13a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:08:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:33 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:08:33 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b95b4-755d-4c87-a110-236c28a3e553]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'galzmefW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Instance destroyed successfully.
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'resources' on Instance uuid 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-467904036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-467904036',id=27,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-lv5bkzvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:06:46Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=351a0f4e-b337-49ec-8dfb-cde20c1fbc3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "address": "fa:16:3e:76:05:1e", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b08ec95-48", "ovs_interfaceid": "4b08ec95-4889-4a7e-8d14-e849bb924edb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_vif [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b08ec95-48, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:33 user nova-compute[72780]: INFO os_vif [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:05:1e,bridge_name='br-int',has_traffic_filtering=True,id=4b08ec95-4889-4a7e-8d14-e849bb924edb,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b08ec95-48')
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqSNbBRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:08:33 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.946s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26333353339623065', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333353339623065', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.676s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.objects.instance [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'flavor' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68cbdce-deba-4246-b233-34bcd68256df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:08:34 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:08:34 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:08:34 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:08:34 user nova-compute[72780]:   <serial>b52b6a9c-9fc7-4e10-a9cd-312c56ae0953</serial>
Aug 09 01:08:34 user nova-compute[72780]: </disk>
Aug 09 01:08:34 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fa47a1-083c-49e7-a76d-326c9a72f931]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:08:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:34 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:08:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01d5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9dd5d4-be96-492f-b1fd-386c7923b4b2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a0989f-3c7a-4ba5-b039-7c98d7502fd7]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f8b6a-4181-4e34-a515-ebb50b1bf977]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b578358c-259c-4108-a334-7103c47a4a6d]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3582e91c-a699-4fa2-bf26-cc77b14613cc]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c941bd9-be9c-42bf-a654-326da772102d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260]
Aug 09 01:08:34 user nova-compute[72780]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce, portal: 172.16.0.220,3260] successful.
Aug 09 01:08:34 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50899620-dc05-4248-8f59-068c949cebce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00abecbd-426f-43f7-b8e6-f878849faf61]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== disconnect_volume: return (991ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:08:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Deleting instance files /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e_del
Aug 09 01:08:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Deletion of /opt/stack/data/nova/instances/351a0f4e-b337-49ec-8dfb-cde20c1fbc3e_del complete
Aug 09 01:08:34 user nova-compute[72780]: INFO nova.compute.manager [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Took 1.92 seconds to destroy the instance on the hypervisor.
Aug 09 01:08:34 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No VIF found with MAC fa:16:3e:d8:b6:0b, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-be544180-7bb9-4485-a10f-d0f5f304a01b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.457s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-6fd03530-3fa6-4f75-b579-1c2dd5e1e829 req-a36fb623-f7ba-4149-b12c-d76d581dfe5f service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6fd03530-3fa6-4f75-b579-1c2dd5e1e829 req-a36fb623-f7ba-4149-b12c-d76d581dfe5f service nova] Acquiring lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6fd03530-3fa6-4f75-b579-1c2dd5e1e829 req-a36fb623-f7ba-4149-b12c-d76d581dfe5f service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6fd03530-3fa6-4f75-b579-1c2dd5e1e829 req-a36fb623-f7ba-4149-b12c-d76d581dfe5f service nova] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-6fd03530-3fa6-4f75-b579-1c2dd5e1e829 req-a36fb623-f7ba-4149-b12c-d76d581dfe5f service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] No waiting events found dispatching network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:35 user nova-compute[72780]: WARNING nova.compute.manager [req-6fd03530-3fa6-4f75-b579-1c2dd5e1e829 req-a36fb623-f7ba-4149-b12c-d76d581dfe5f service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received unexpected event network-vif-plugged-4b08ec95-4889-4a7e-8d14-e849bb924edb for instance with vm_state active and task_state deleting.
Aug 09 01:08:35 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:35 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Took 0.72 seconds to deallocate network for instance.
Aug 09 01:08:35 user nova-compute[72780]: INFO nova.compute.manager [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Rescuing
Aug 09 01:08:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:08:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:36 user nova-compute[72780]: INFO nova.compute.manager [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Took 0.77 seconds to detach 1 volumes for instance.
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:36 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Deleted allocations for instance 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e
Aug 09 01:08:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-518900cf-d5f6-4543-a448-1fec8b1d73a1 req-f63df22e-c9de-4e72-a360-965e70fc0f92 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-518900cf-d5f6-4543-a448-1fec8b1d73a1 req-f63df22e-c9de-4e72-a360-965e70fc0f92 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-518900cf-d5f6-4543-a448-1fec8b1d73a1 req-f63df22e-c9de-4e72-a360-965e70fc0f92 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-518900cf-d5f6-4543-a448-1fec8b1d73a1 req-f63df22e-c9de-4e72-a360-965e70fc0f92 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-518900cf-d5f6-4543-a448-1fec8b1d73a1 req-f63df22e-c9de-4e72-a360-965e70fc0f92 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:36 user nova-compute[72780]: WARNING nova.compute.manager [req-518900cf-d5f6-4543-a448-1fec8b1d73a1 req-f63df22e-c9de-4e72-a360-965e70fc0f92 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1ffad3ea-7b99-4091-8c7c-a0672cab79e3 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "351a0f4e-b337-49ec-8dfb-cde20c1fbc3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.988s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-40f8760a-e4f2-4dac-86f6-d91d12fd377b req-62432311-f64e-4681-ad7b-0e30e1b6a76c service nova] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Received event network-vif-deleted-4b08ec95-4889-4a7e-8d14-e849bb924edb {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:37 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance destroyed successfully.
Aug 09 01:08:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:37 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Attempting a stable device rescue
Aug 09 01:08:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72780) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 01:08:37 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Creating image(s)
Aug 09 01:08:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG nova.objects.instance [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "d07564c48cf40a91c7456d73fe209e601c5549c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "d07564c48cf40a91c7456d73fe209e601c5549c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:38 user nova-compute[72780]: WARNING nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:38 user nova-compute[72780]: WARNING nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:38 user nova-compute[72780]: WARNING nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:38 user nova-compute[72780]: WARNING nova.compute.manager [req-61c4cf62-639d-4c03-a7ad-b037e39d0c38 req-7c83afea-bfef-4357-bd34-531680722143 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.part --force-share --output=json" returned: 0 in 0.160s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.virt.images [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] 2859ac66-3f39-4347-a4cc-f5c9b4fe6012 was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:08:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.part /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.part /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.converted" returned: 0 in 0.632s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "d07564c48cf40a91c7456d73fe209e601c5549c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.178s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "d07564c48cf40a91c7456d73fe209e601c5549c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "d07564c48cf40a91c7456d73fe209e601c5549c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3 --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3,backing_fmt=raw /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3,backing_fmt=raw /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue" returned: 0 in 0.051s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "d07564c48cf40a91c7456d73fe209e601c5549c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'migration_context' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Start _get_guest_xml network_info=[{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "vif_mac": "fa:16:3e:d8:b6:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2859ac66-3f39-4347-a4cc-f5c9b4fe6012', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'galzmefW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '61c9d542-625d-4683-8b61-291c47d1fa91', 'attached_at': '', 'detached_at': '', 'volume_id': 'b52b6a9c-9fc7-4e10-a9cd-312c56ae0953', 'serial': 'b52b6a9c-9fc7-4e10-a9cd-312c56ae0953'}, 'disk_bus': 'virtio', 'attachment_id': '8a3e53f8-8a4c-4572-be89-d51f50e4b8e4', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'resources' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'numa_topology' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:39 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:39 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:08:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'galzmefW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:08:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:08:40 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[41156f79-30c7-4a7e-9a64-22a9f24d4ee6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = galzmefW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 01:08:40 user nova-compute[72780]: node.name = iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953
Aug 09 01:08:40 user nova-compute[72780]: node.tpgt = -1
Aug 09 01:08:40 user nova-compute[72780]: node.startup = automatic
Aug 09 01:08:40 user nova-compute[72780]: node.leading_login = No
Aug 09 01:08:40 user nova-compute[72780]: iface.iscsi_ifacename = default
Aug 09 01:08:40 user nova-compute[72780]: iface.net_ifacename = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.ipaddress = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.prefix_len = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.hwaddress = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.transport_name = tcp
Aug 09 01:08:40 user nova-compute[72780]: iface.initiatorname = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.vlan_id = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.vlan_priority = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.vlan_state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.iface_num = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.mtu = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.port = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.bootproto = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.subnet_mask = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.gateway = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_alt_client_id = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_dns = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_learn_iqn = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_vendor_id_state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_vendor_id = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.dhcp_slp_da = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.fragmentation = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.gratuitous_arp = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.incoming_forwarding = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.tos_state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.tos = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.ttl = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.delayed_ack = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.tcp_nagle = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.tcp_wsf_state = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.tcp_wsf = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.tcp_timer_scale = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.tcp_timestamp = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.redirect = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.def_task_mgmt_timeout = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.header_digest = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.data_digest = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.immediate_data = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.initial_r2t = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.data_seq_inorder = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.data_pdu_inorder = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.erl = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.max_receive_data_len = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.first_burst_len = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.max_outstanding_r2t = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.max_burst_len = 0
Aug 09 01:08:40 user nova-compute[72780]: iface.chap_auth = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.bidi_chap = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.strict_login_compliance = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.discovery_auth = <empty>
Aug 09 01:08:40 user nova-compute[72780]: iface.discovery_logout = <empty>
Aug 09 01:08:40 user nova-compute[72780]: node.discovery_address = <empty>
Aug 09 01:08:40 user nova-compute[72780]: node.discovery_port = 0
Aug 09 01:08:40 user nova-compute[72780]: node.discovery_type = static
Aug 09 01:08:40 user nova-compute[72780]: node.session.initial_cmdsn = 0
Aug 09 01:08:40 user nova-compute[72780]: node.session.initial_login_retry_max = 8
Aug 09 01:08:40 user nova-compute[72780]: node.session.xmit_thread_priority = -20
Aug 09 01:08:40 user nova-compute[72780]: node.session.cmds_max = 128
Aug 09 01:08:40 user nova-compute[72780]: node.session.queue_depth = 32
Aug 09 01:08:40 user nova-compute[72780]: node.session.nr_sessions = 1
Aug 09 01:08:40 user nova-compute[72780]: node.session.auth.authmethod = CHAP
Aug 09 01:08:40 user nova-compute[72780]: node.session.auth.username = galzmefW
Aug 09 01:08:40 user nova-compute[72780]: node.session.auth.password = ***
Aug 09 01:08:40 user nova-compute[72780]: node.session.auth.username_in = <empty>
Aug 09 01:08:40 user nova-compute[72780]: node.session.auth.password_in = <empty>
Aug 09 01:08:40 user nova-compute[72780]: node.session.auth.chap_algs = MD5
Aug 09 01:08:40 user nova-compute[72780]: node.session.timeo.replacement_timeout = 120
Aug 09 01:08:40 user nova-compute[72780]: node.session.err_timeo.abort_timeout = 15
Aug 09 01:08:40 user nova-compute[72780]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 01:08:40 user nova-compute[72780]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 01:08:40 user nova-compute[72780]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.FastAbort = Yes
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.InitialR2T = No
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.ImmediateData = Yes
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.MaxConnections = 1
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 01:08:40 user nova-compute[72780]: node.session.iscsi.ERL = 0
Aug 09 01:08:40 user nova-compute[72780]: node.session.scan = manual
Aug 09 01:08:40 user nova-compute[72780]: node.session.reopen_max = 0
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].address = 172.16.0.220
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].port = 3260
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].startup = manual
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].tcp.window_size = 524288
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].tcp.type_of_service = 0
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].timeo.logout_timeout = 15
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].timeo.login_timeout = 15
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].timeo.auth_timeout = 45
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].iscsi.DataDigest = None
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].iscsi.IFMarker = No
Aug 09 01:08:40 user nova-compute[72780]: node.conn[0].iscsi.OFMarker = No
Aug 09 01:08:40 user nova-compute[72780]: # END RECORD
Aug 09 01:08:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f67439-dfa1-4749-83d8-1474341b73a5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5843304d-fc76-4d9f-966c-0b3ac1488a58]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v galzmefW {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v galzmefW" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[683bba3f-d324-45e8-a386-6be047eebb47]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'galzmefW'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c205ae-1492-4cbc-becc-ef3dd703562b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb685e-9c7c-4b15-b8ed-d3388760a462]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:40 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:40 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:40 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:08:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:08:40 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:08:40 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:08:40 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:08:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] HCTL ('34', '0', '0', 0) found on session 40 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e027b7e-c921-4d9c-85d7-d025b44eafcf]: (4, ('0 0 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Searching for a device in session 40 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'galzmefW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26333353339623065', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333353339623065', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1567257275',display_name='tempest-ServerStableDeviceRescueTest-server-1567257275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1567257275',id=31,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUzekflLmlc5LAkJ2IatdZQbNepkB4OsrCtPb1gR4RsNKgy6wIJTXSry7i+VdTW71w4+uZPP/x/hxiC1Ey1ZzrEmANlETYF6Stigj5NUnyU05i/BmaJEeeB2dwZ355dA==',key_name='tempest-keypair-904094662',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f635836b7a148b7a1e12c818e5edaeb',ramdisk_id='',reservation_id='r-bwz2a2uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-506067792',owner_user_name='tempest-ServerStableDeviceRescueTest-506067792-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d5adbbde00b43678092c96e19826a51',uuid=61c9d542-625d-4683-8b61-291c47d1fa91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "vif_mac": "fa:16:3e:d8:b6:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converting VIF {"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "vif_mac": "fa:16:3e:d8:b6:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'pci_devices' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:08:40 user nova-compute[72780]:   <uuid>61c9d542-625d-4683-8b61-291c47d1fa91</uuid>
Aug 09 01:08:40 user nova-compute[72780]:   <name>instance-0000001f</name>
Aug 09 01:08:40 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:08:40 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:08:40 user nova-compute[72780]:   <metadata>
Aug 09 01:08:40 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:08:40 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:08:40 user nova-compute[72780]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1567257275</nova:name>
Aug 09 01:08:40 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:08:39</nova:creationTime>
Aug 09 01:08:40 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:08:40 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:08:40 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:08:40 user nova-compute[72780]:       <nova:owner>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:user uuid="0d5adbbde00b43678092c96e19826a51">tempest-ServerStableDeviceRescueTest-506067792-project-member</nova:user>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:project uuid="8f635836b7a148b7a1e12c818e5edaeb">tempest-ServerStableDeviceRescueTest-506067792</nova:project>
Aug 09 01:08:40 user nova-compute[72780]:       </nova:owner>
Aug 09 01:08:40 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:08:40 user nova-compute[72780]:       <nova:ports>
Aug 09 01:08:40 user nova-compute[72780]:         <nova:port uuid="d51c0ac4-c7b3-4865-a20f-838a2a837956">
Aug 09 01:08:40 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:08:40 user nova-compute[72780]:         </nova:port>
Aug 09 01:08:40 user nova-compute[72780]:       </nova:ports>
Aug 09 01:08:40 user nova-compute[72780]:     </nova:instance>
Aug 09 01:08:40 user nova-compute[72780]:   </metadata>
Aug 09 01:08:40 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:08:40 user nova-compute[72780]:     <system>
Aug 09 01:08:40 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:08:40 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:08:40 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:08:40 user nova-compute[72780]:       <entry name="serial">61c9d542-625d-4683-8b61-291c47d1fa91</entry>
Aug 09 01:08:40 user nova-compute[72780]:       <entry name="uuid">61c9d542-625d-4683-8b61-291c47d1fa91</entry>
Aug 09 01:08:40 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:08:40 user nova-compute[72780]:     </system>
Aug 09 01:08:40 user nova-compute[72780]:   </sysinfo>
Aug 09 01:08:40 user nova-compute[72780]:   <os>
Aug 09 01:08:40 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:08:40 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:08:40 user nova-compute[72780]:   </os>
Aug 09 01:08:40 user nova-compute[72780]:   <features>
Aug 09 01:08:40 user nova-compute[72780]:     <acpi/>
Aug 09 01:08:40 user nova-compute[72780]:     <apic/>
Aug 09 01:08:40 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:08:40 user nova-compute[72780]:   </features>
Aug 09 01:08:40 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:08:40 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:08:40 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:08:40 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:08:40 user nova-compute[72780]:   </clock>
Aug 09 01:08:40 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:08:40 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:08:40 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:08:40 user nova-compute[72780]:   </cpu>
Aug 09 01:08:40 user nova-compute[72780]:   <devices>
Aug 09 01:08:40 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:08:40 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:08:40 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk"/>
Aug 09 01:08:40 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:08:40 user nova-compute[72780]:     </disk>
Aug 09 01:08:40 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:08:40 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:08:40 user nova-compute[72780]:       <source dev="/dev/sdc"/>
Aug 09 01:08:40 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:08:40 user nova-compute[72780]:       <serial>b52b6a9c-9fc7-4e10-a9cd-312c56ae0953</serial>
Aug 09 01:08:40 user nova-compute[72780]:     </disk>
Aug 09 01:08:40 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:08:40 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:08:40 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue"/>
Aug 09 01:08:40 user nova-compute[72780]:       <target dev="vdc" bus="virtio"/>
Aug 09 01:08:40 user nova-compute[72780]:       <boot order="1"/>
Aug 09 01:08:40 user nova-compute[72780]:     </disk>
Aug 09 01:08:40 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:08:40 user nova-compute[72780]:       <mac address="fa:16:3e:d8:b6:0b"/>
Aug 09 01:08:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:08:40 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:08:40 user nova-compute[72780]:       <target dev="tapd51c0ac4-c7"/>
Aug 09 01:08:40 user nova-compute[72780]:     </interface>
Aug 09 01:08:40 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:08:40 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/console.log" append="off"/>
Aug 09 01:08:40 user nova-compute[72780]:     </serial>
Aug 09 01:08:40 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:08:40 user nova-compute[72780]:     <video>
Aug 09 01:08:40 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:08:40 user nova-compute[72780]:     </video>
Aug 09 01:08:40 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:08:40 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:08:40 user nova-compute[72780]:     </rng>
Aug 09 01:08:40 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:08:40 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:08:40 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:08:40 user nova-compute[72780]:     </memballoon>
Aug 09 01:08:40 user nova-compute[72780]:   </devices>
Aug 09 01:08:40 user nova-compute[72780]: </domain>
Aug 09 01:08:40 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:08:40 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance destroyed successfully.
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] No VIF found with MAC fa:16:3e:d8:b6:0b, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bdf819a-3e65-4b10-aa46-9bdeaa502ea0 req-d01dc208-33b4-40ee-b104-b92eaa91b126 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bdf819a-3e65-4b10-aa46-9bdeaa502ea0 req-d01dc208-33b4-40ee-b104-b92eaa91b126 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bdf819a-3e65-4b10-aa46-9bdeaa502ea0 req-d01dc208-33b4-40ee-b104-b92eaa91b126 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bdf819a-3e65-4b10-aa46-9bdeaa502ea0 req-d01dc208-33b4-40ee-b104-b92eaa91b126 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bdf819a-3e65-4b10-aa46-9bdeaa502ea0 req-d01dc208-33b4-40ee-b104-b92eaa91b126 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:40 user nova-compute[72780]: WARNING nova.compute.manager [req-3bdf819a-3e65-4b10-aa46-9bdeaa502ea0 req-d01dc208-33b4-40ee-b104-b92eaa91b126 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:42 user nova-compute[72780]: WARNING nova.compute.manager [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:08:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:08:42 user nova-compute[72780]: WARNING nova.compute.manager [req-a0072d46-112f-460c-a73e-aa7aee2b6ef7 req-59466b93-9d61-4f62-ba92-3a1eb526f98f service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state active and task_state rescuing.
Aug 09 01:08:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for 61c9d542-625d-4683-8b61-291c47d1fa91 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543324.0124164, 61c9d542-625d-4683-8b61-291c47d1fa91 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Resumed (Lifecycle Event)
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-03b0faea-d93f-43f7-88f6-8e6eece05b1b tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:08:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543324.0148344, 61c9d542-625d-4683-8b61-291c47d1fa91 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:44 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Started (Lifecycle Event)
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:08:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:48 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543313.590206, 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:08:48 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] VM Stopped (Lifecycle Event)
Aug 09 01:08:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7d224cc0-ce81-4c7e-9b7a-0ba0e6936321 None None] [instance: 351a0f4e-b337-49ec-8dfb-cde20c1fbc3e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:08:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:08:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:09:03 user nova-compute[72780]: INFO nova.compute.claims [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Claim successful on node user
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:09:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:09:03 user nova-compute[72780]: INFO nova.virt.block_device [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Booting with volume be5328c3-a649-47d0-9365-284accb9ec38 at /dev/vda
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.policy [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a94bf4a8aa224f5e8568d1bd4be408f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '040b6f9693f942fe9cf0fbce3d015e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG os_brick.utils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2f28f5-848b-478d-9900-bf9b998e8d77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2003b6b2-dc18-45fe-bd52-3e7ea3ef300e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d25161-496b-4cfc-b4b9-e0cb89708fae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c6530-fee7-487f-947b-4a7f7d834f03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:09:03 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:09:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[371208e0-b4b6-4cb8-bf73-2fab062ad892]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG os_brick.utils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:03 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating existing volume attachment record: 85181bac-7a00-4868-a086-8c9fd6949ce2 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:09:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Successfully created port: e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:09:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-changed-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Refreshing instance network info cache due to event network-changed-2e22afce-83a2-4c64-98ea-95591cc04ad0. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:09:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] Acquiring lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:09:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] Acquired lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:09:04 user nova-compute[72780]: DEBUG nova.network.neutron [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Refreshing network info cache for port 2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updated VIF entry in instance network info cache for port 2e22afce-83a2-4c64-98ea-95591cc04ad0. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating instance_info_cache with network_info: [{"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d46ee6ae-1f71-432a-9ba1-fffa07824438 req-db732187-718c-4a45-887a-867be999e051 service nova] Releasing lock "refresh_cache-006a70f2-b9aa-47eb-b885-8f9e68926cca" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.objects.instance [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'flavor' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Successfully updated port: e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquired lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-changed-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Refreshing instance network info cache due to event network-changed-e4236ae9-35df-4fb2-92e2-8908dc00cdd9. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] Acquiring lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:05 user nova-compute[72780]: INFO nova.compute.manager [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attaching volume 5051731a-5879-443c-81b4-efef84d9a551 to /dev/vdb
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG os_brick.utils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[831c494f-bb25-4d92-b4c5-e80d700b33f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1530a858-29ba-455c-adfd-c2aab9336560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b94615-5a18-4cf1-a3ad-27ad04711ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d10fc0-d6c4-4efc-954c-19a45cdbdb59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:09:05 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ba34b-5ece-4f67-acfb-78705f8c8632]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG os_brick.utils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating existing volume attachment record: 623f32c6-b572-46d6-8657-67f4107ca3be {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating instance_info_cache with network_info: [{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Releasing lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance network_info: |[{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] Acquired lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:09:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Refreshing network info cache for port e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:09:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:06 user nova-compute[72780]: DEBUG nova.network.neutron [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updated VIF entry in instance network info cache for port e4236ae9-35df-4fb2-92e2-8908dc00cdd9. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:09:06 user nova-compute[72780]: DEBUG nova.network.neutron [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating instance_info_cache with network_info: [{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:09:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3faf615d-827f-47c6-b3ce-ca84a1668497 req-49906ece-1950-4fc5-8ce5-4807fbac3efd service nova] Releasing lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:09:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:09:12 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Creating image(s)
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Ensure instance console log exists: /opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Start _get_guest_xml network_info=[{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b8a7c86-1bdf-4cf9-8064-a2505c9b2366', 'attached_at': '', 'detached_at': '', 'volume_id': 'be5328c3-a649-47d0-9365-284accb9ec38', 'serial': 'be5328c3-a649-47d0-9365-284accb9ec38'}, 'disk_bus': 'virtio', 'attachment_id': '85181bac-7a00-4868-a086-8c9fd6949ce2', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:09:12 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:09:12 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:12 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:12 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:12 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[247fc949-822f-4c65-b631-abea3fc9aa5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:09:12 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e488b57-9e8e-4316-9e68-5c96af3e228d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38] added
Aug 09 01:09:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20adb8-fc9d-4a0e-91cc-fe3453f422f7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eecefb0-ec73-46b2-ac11-74c3775f81b7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adkvBpDU {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adkvBpDU" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21bba1a-c0ef-4898-ad95-384780601b31]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'adkvBpDU'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f86d4-8cb0-4102-9050-29868d3230e6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b7711-40d2-4770-9ce5-6576c5557ab5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5028ccf-fc43-4463-b8ae-4817e6bef2ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]
Aug 09 01:09:12 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.
Aug 09 01:09:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae31ee-c6ee-488e-aac1-9d7803275f73]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6129aa9-d6d1-44b8-baca-6f902ddac4f1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:12 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[407fbef8-56d0-47cd-be9a-528929b09884]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:09:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23361326237353362', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361326237353362', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1890691155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1890691155',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwqtgwy2TT9KcvouviRj8PUBjCw3OhwSi4n7Zob4lglKVdHHrd8lvhPzfTAAe1qzH1pBuNK9oqDnfgUziMnK5qU/yF13yQEfIt+GZ3tI19B/wS3/2cK3+8/yFESYALC4w==',key_name='tempest-keypair-385507197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='040b6f9693f942fe9cf0fbce3d015e29',ramdisk_id='',reservation_id='r-i3ic35y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2020741728',owner_user_name='tempest-ServerActionsV293TestJSON-2020741728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a94bf4a8aa224f5e8568d1bd4be408f5',uuid=5b8a7c86-1bdf-4cf9-8064-a2505c9b2366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converting VIF {"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:09:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:09:14 user nova-compute[72780]:   <uuid>5b8a7c86-1bdf-4cf9-8064-a2505c9b2366</uuid>
Aug 09 01:09:14 user nova-compute[72780]:   <name>instance-00000025</name>
Aug 09 01:09:14 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:09:14 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:09:14 user nova-compute[72780]:   <metadata>
Aug 09 01:09:14 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:09:14 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:09:14 user nova-compute[72780]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1890691155</nova:name>
Aug 09 01:09:14 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:09:12</nova:creationTime>
Aug 09 01:09:14 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:09:14 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:09:14 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:09:14 user nova-compute[72780]:       <nova:owner>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:user uuid="a94bf4a8aa224f5e8568d1bd4be408f5">tempest-ServerActionsV293TestJSON-2020741728-project-member</nova:user>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:project uuid="040b6f9693f942fe9cf0fbce3d015e29">tempest-ServerActionsV293TestJSON-2020741728</nova:project>
Aug 09 01:09:14 user nova-compute[72780]:       </nova:owner>
Aug 09 01:09:14 user nova-compute[72780]:       <nova:ports>
Aug 09 01:09:14 user nova-compute[72780]:         <nova:port uuid="e4236ae9-35df-4fb2-92e2-8908dc00cdd9">
Aug 09 01:09:14 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 01:09:14 user nova-compute[72780]:         </nova:port>
Aug 09 01:09:14 user nova-compute[72780]:       </nova:ports>
Aug 09 01:09:14 user nova-compute[72780]:     </nova:instance>
Aug 09 01:09:14 user nova-compute[72780]:   </metadata>
Aug 09 01:09:14 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:09:14 user nova-compute[72780]:     <system>
Aug 09 01:09:14 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:09:14 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:09:14 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:09:14 user nova-compute[72780]:       <entry name="serial">5b8a7c86-1bdf-4cf9-8064-a2505c9b2366</entry>
Aug 09 01:09:14 user nova-compute[72780]:       <entry name="uuid">5b8a7c86-1bdf-4cf9-8064-a2505c9b2366</entry>
Aug 09 01:09:14 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:09:14 user nova-compute[72780]:     </system>
Aug 09 01:09:14 user nova-compute[72780]:   </sysinfo>
Aug 09 01:09:14 user nova-compute[72780]:   <os>
Aug 09 01:09:14 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:09:14 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:09:14 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:09:14 user nova-compute[72780]:   </os>
Aug 09 01:09:14 user nova-compute[72780]:   <features>
Aug 09 01:09:14 user nova-compute[72780]:     <acpi/>
Aug 09 01:09:14 user nova-compute[72780]:     <apic/>
Aug 09 01:09:14 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:09:14 user nova-compute[72780]:   </features>
Aug 09 01:09:14 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:09:14 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:09:14 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:09:14 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:09:14 user nova-compute[72780]:   </clock>
Aug 09 01:09:14 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:09:14 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:09:14 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:09:14 user nova-compute[72780]:   </cpu>
Aug 09 01:09:14 user nova-compute[72780]:   <devices>
Aug 09 01:09:14 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:09:14 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:09:14 user nova-compute[72780]:       <source dev="/dev/sdd"/>
Aug 09 01:09:14 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:09:14 user nova-compute[72780]:       <serial>be5328c3-a649-47d0-9365-284accb9ec38</serial>
Aug 09 01:09:14 user nova-compute[72780]:     </disk>
Aug 09 01:09:14 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:09:14 user nova-compute[72780]:       <mac address="fa:16:3e:16:cc:ae"/>
Aug 09 01:09:14 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:09:14 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:09:14 user nova-compute[72780]:       <target dev="tape4236ae9-35"/>
Aug 09 01:09:14 user nova-compute[72780]:     </interface>
Aug 09 01:09:14 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:09:14 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366/console.log" append="off"/>
Aug 09 01:09:14 user nova-compute[72780]:     </serial>
Aug 09 01:09:14 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:09:14 user nova-compute[72780]:     <video>
Aug 09 01:09:14 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:09:14 user nova-compute[72780]:     </video>
Aug 09 01:09:14 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:09:14 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:09:14 user nova-compute[72780]:     </rng>
Aug 09 01:09:14 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:09:14 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:09:14 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:09:14 user nova-compute[72780]:     </memballoon>
Aug 09 01:09:14 user nova-compute[72780]:   </devices>
Aug 09 01:09:14 user nova-compute[72780]: </domain>
Aug 09 01:09:14 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1890691155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1890691155',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwqtgwy2TT9KcvouviRj8PUBjCw3OhwSi4n7Zob4lglKVdHHrd8lvhPzfTAAe1qzH1pBuNK9oqDnfgUziMnK5qU/yF13yQEfIt+GZ3tI19B/wS3/2cK3+8/yFESYALC4w==',key_name='tempest-keypair-385507197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='040b6f9693f942fe9cf0fbce3d015e29',ramdisk_id='',reservation_id='r-i3ic35y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2020741728',owner_user_name='tempest-ServerActionsV293TestJSON-2020741728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a94bf4a8aa224f5e8568d1bd4be408f5',uuid=5b8a7c86-1bdf-4cf9-8064-a2505c9b2366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converting VIF {"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_vif [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4236ae9-35, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4236ae9-35, col_values=(('external_ids', {'iface-id': 'e4236ae9-35df-4fb2-92e2-8908dc00cdd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:cc:ae', 'vm-uuid': '5b8a7c86-1bdf-4cf9-8064-a2505c9b2366'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:14 user nova-compute[72780]: INFO os_vif [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35')
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] No VIF found with MAC fa:16:3e:16:cc:ae, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnACjSoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:14 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:14 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:14 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfecdd9-fc67-44a2-a1e2-c9ea9b17738e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:09:14 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[657310e1-59b0-4746-bb93-d2e3a1d440c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551] added
Aug 09 01:09:14 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[70923b9a-6109-4d15-9214-2e4464c7f43a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856546d-3465-4638-b00a-7a5690830d72]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnACjSoP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnACjSoP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c7db94-2ce9-4613-9654-e6cc2d028e41]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnACjSoP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40e4b47-2e94-4c41-9c02-81d8b25ed89e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a65e4e9-e2ca-49f5-ae58-e63703588c7f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bddafa2-7e80-4c06-915d-a417cef13e71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260]
Aug 09 01:09:14 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260] successful.
Aug 09 01:09:14 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00954cf2-fc47-4799-853b-38e565888290]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c4d2d2-2adc-46fd-8183-fe55344e57f9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:14 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae596d4e-6b3c-45d1-b421-bce72da9950d]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:09:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnACjSoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-2ca2492b-625e-47df-82e3-95d613d0dcc7 req-9ddf1f10-2d7d-4e23-aea1-d6bb1f1d99a8 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2ca2492b-625e-47df-82e3-95d613d0dcc7 req-9ddf1f10-2d7d-4e23-aea1-d6bb1f1d99a8 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2ca2492b-625e-47df-82e3-95d613d0dcc7 req-9ddf1f10-2d7d-4e23-aea1-d6bb1f1d99a8 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2ca2492b-625e-47df-82e3-95d613d0dcc7 req-9ddf1f10-2d7d-4e23-aea1-d6bb1f1d99a8 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-2ca2492b-625e-47df-82e3-95d613d0dcc7 req-9ddf1f10-2d7d-4e23-aea1-d6bb1f1d99a8 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:09:15 user nova-compute[72780]: WARNING nova.compute.manager [req-2ca2492b-625e-47df-82e3-95d613d0dcc7 req-9ddf1f10-2d7d-4e23-aea1-d6bb1f1d99a8 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state building and task_state spawning.
Aug 09 01:09:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23130613437653031', 'path': '/dev/sde'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130613437653031', 'path': '/dev/sde'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG nova.objects.instance [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'flavor' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:09:15 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:09:15 user nova-compute[72780]:   <source dev="/dev/sde"/>
Aug 09 01:09:15 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:09:15 user nova-compute[72780]:   <serial>5051731a-5879-443c-81b4-efef84d9a551</serial>
Aug 09 01:09:15 user nova-compute[72780]: </disk>
Aug 09 01:09:15 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No VIF found with MAC fa:16:3e:af:a5:ac, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-91638eff-6a66-4349-9715-d2258b626d5b tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.839s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-b41b205d-e9a0-4e2e-977e-3596d7c781cd req-a814de09-1dc6-49fa-9764-f5a80f590583 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b41b205d-e9a0-4e2e-977e-3596d7c781cd req-a814de09-1dc6-49fa-9764-f5a80f590583 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b41b205d-e9a0-4e2e-977e-3596d7c781cd req-a814de09-1dc6-49fa-9764-f5a80f590583 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b41b205d-e9a0-4e2e-977e-3596d7c781cd req-a814de09-1dc6-49fa-9764-f5a80f590583 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-b41b205d-e9a0-4e2e-977e-3596d7c781cd req-a814de09-1dc6-49fa-9764-f5a80f590583 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:09:17 user nova-compute[72780]: WARNING nova.compute.manager [req-b41b205d-e9a0-4e2e-977e-3596d7c781cd req-a814de09-1dc6-49fa-9764-f5a80f590583 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state building and task_state spawning.
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543357.7602317, 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] VM Resumed (Lifecycle Event)
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance spawned successfully.
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543357.760395, 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] VM Started (Lifecycle Event)
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 09 01:09:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:09:17 user nova-compute[72780]: INFO nova.compute.manager [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Took 14.79 seconds to build instance.
Aug 09 01:09:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3c5eb0b-3a6d-47d2-991f-8fb11ed6d37f tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.879s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'flavor' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:20 user nova-compute[72780]: INFO nova.compute.manager [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attaching volume a0170af5-fdaa-4008-82fe-81a271776cd5 to /dev/vdc
Aug 09 01:09:20 user nova-compute[72780]: DEBUG os_brick.utils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b8f57-34a2-4ffb-86c9-e31dec900731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add7c8c-cba0-4230-959a-d740929e2904]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc103a60-b12b-464d-b9be-f944855eb86a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d3c792-415e-4c03-896f-1662a6206cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:09:20 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:09:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[042cd23c-4e57-4db3-98c5-c1af79ebb801]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG os_brick.utils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:20 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating existing volume attachment record: afd63583-68e3-4fca-a759-629738084d9a {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:09:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "eef82018-54b7-471d-bee1-45bf26de56e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:21 user nova-compute[72780]: INFO nova.compute.manager [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Terminating instance
Aug 09 01:09:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-65da0766-1906-477e-a845-2804b910838e req-2f54b21b-81c4-4351-aea8-0df471ec58ae service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-vif-unplugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-65da0766-1906-477e-a845-2804b910838e req-2f54b21b-81c4-4351-aea8-0df471ec58ae service nova] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-65da0766-1906-477e-a845-2804b910838e req-2f54b21b-81c4-4351-aea8-0df471ec58ae service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-65da0766-1906-477e-a845-2804b910838e req-2f54b21b-81c4-4351-aea8-0df471ec58ae service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-65da0766-1906-477e-a845-2804b910838e req-2f54b21b-81c4-4351-aea8-0df471ec58ae service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] No waiting events found dispatching network-vif-unplugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-65da0766-1906-477e-a845-2804b910838e req-2f54b21b-81c4-4351-aea8-0df471ec58ae service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-vif-unplugged-6142885d-d0dd-419f-a811-b0a904b02740 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Instance destroyed successfully.
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'resources' on Instance uuid eef82018-54b7-471d-bee1-45bf26de56e1 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-866301270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-866301270',id=22,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-1emtxv3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:01:56Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=eef82018-54b7-471d-bee1-45bf26de56e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6142885d-d0dd-419f-a811-b0a904b02740", "address": "fa:16:3e:14:84:02", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6142885d-d0", "ovs_interfaceid": "6142885d-d0dd-419f-a811-b0a904b02740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG os_vif [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6142885d-d0, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:09:22 user nova-compute[72780]: INFO os_vif [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:84:02,bridge_name='br-int',has_traffic_filtering=True,id=6142885d-d0dd-419f-a811-b0a904b02740,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6142885d-d0')
Aug 09 01:09:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Deleting instance files /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1_del
Aug 09 01:09:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Deletion of /opt/stack/data/nova/instances/eef82018-54b7-471d-bee1-45bf26de56e1_del complete
Aug 09 01:09:22 user nova-compute[72780]: INFO nova.compute.manager [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 09 01:09:22 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:09:22 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:09:23 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:09:23 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Took 0.95 seconds to deallocate network for instance.
Aug 09 01:09:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-c6395f37-5cc1-4966-8131-7398c9c58a72 req-6d51d4e3-64ec-45d7-a57c-2585e9f1f538 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-vif-deleted-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:23 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:09:23 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:24 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Deleted allocations for instance eef82018-54b7-471d-bee1-45bf26de56e1
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ea0661e2-293c-4bfa-9510-505e1c34ddca tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "eef82018-54b7-471d-bee1-45bf26de56e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-fc36d723-4c18-4441-bbcd-f7f63cf3daf6 req-8308c0f2-754a-44a3-a2f3-8acf05b08368 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received event network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fc36d723-4c18-4441-bbcd-f7f63cf3daf6 req-8308c0f2-754a-44a3-a2f3-8acf05b08368 service nova] Acquiring lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fc36d723-4c18-4441-bbcd-f7f63cf3daf6 req-8308c0f2-754a-44a3-a2f3-8acf05b08368 service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fc36d723-4c18-4441-bbcd-f7f63cf3daf6 req-8308c0f2-754a-44a3-a2f3-8acf05b08368 service nova] Lock "eef82018-54b7-471d-bee1-45bf26de56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-fc36d723-4c18-4441-bbcd-f7f63cf3daf6 req-8308c0f2-754a-44a3-a2f3-8acf05b08368 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] No waiting events found dispatching network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:09:24 user nova-compute[72780]: WARNING nova.compute.manager [req-fc36d723-4c18-4441-bbcd-f7f63cf3daf6 req-8308c0f2-754a-44a3-a2f3-8acf05b08368 service nova] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Received unexpected event network-vif-plugged-6142885d-d0dd-419f-a811-b0a904b02740 for instance with vm_state deleted and task_state None.
Aug 09 01:09:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updating instance_info_cache with network_info: [{"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:09:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:09:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:09:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:09:28 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'asihMnDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:29 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b281c2-253a-47e4-a81b-1faef7afb799]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:09:29 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9103b53-3496-4279-b754-5417c3dff4a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5] added
Aug 09 01:09:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f378dcb4-7090-4d8d-a0ec-8c305d86a567]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.049s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c023f-f945-4e2b-a6b0-839ca86b4845]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v asihMnDw {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v asihMnDw" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c9058-346c-420a-adf1-ed18e38729e6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'asihMnDw'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[26512633-f1d6-46fc-9517-616c87932a95]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352c795-e481-4425-82ad-5946a5ae775d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadabecc-b1af-4fe1-9aa7-a2212448e546]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260]
Aug 09 01:09:29 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260] successful.
Aug 09 01:09:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3885421-1ca6-41a9-858b-1bcaddc42a32]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[574b1666-a8c2-4dd4-a582-8ac7fbabdb44]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 (non-flash)
Aug 09 01:09:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bac5e0-82cf-42e5-af1d-4b5923123472]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'asihMnDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26235313931663238', 'path': '/dev/sdg'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235313931663238', 'path': '/dev/sdg'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:09:30 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:09:30 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.02672576904297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.objects.instance [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'flavor' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:09:30 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:09:30 user nova-compute[72780]:   <source dev="/dev/sdg"/>
Aug 09 01:09:30 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:09:30 user nova-compute[72780]:   <serial>a0170af5-fdaa-4008-82fe-81a271776cd5</serial>
Aug 09 01:09:30 user nova-compute[72780]: </disk>
Aug 09 01:09:30 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance a76eeaad-0c42-45c7-8351-a3dacdad0574 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 82b3d395-7aec-4312-8bdd-50a84e8f3830 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 006a70f2-b9aa-47eb-b885-8f9e68926cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance dcd7e878-0475-4004-8a45-c15f405e0883 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eba7383a-8b23-4c07-a628-8a5db60b2e20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:09:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:09:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:09:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:09:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] No VIF found with MAC fa:16:3e:af:a5:ac, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:09:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-098baadf-d4c7-4384-b512-018325980f13 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.052s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:09:32 user nova-compute[72780]: INFO nova.compute.manager [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Detaching volume a0170af5-fdaa-4008-82fe-81a271776cd5
Aug 09 01:09:32 user nova-compute[72780]: INFO nova.virt.block_device [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attempting to driver detach volume a0170af5-fdaa-4008-82fe-81a271776cd5 from mountpoint /dev/vdc
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Attempting to detach device vdc from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:09:32 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:09:32 user nova-compute[72780]:   <source dev="/dev/sdg"/>
Aug 09 01:09:32 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:09:32 user nova-compute[72780]:   <serial>a0170af5-fdaa-4008-82fe-81a271776cd5</serial>
Aug 09 01:09:32 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 01:09:32 user nova-compute[72780]: </disk>
Aug 09 01:09:32 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:09:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Successfully detached device vdc from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the persistent domain config.
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:09:32 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:09:32 user nova-compute[72780]:   <source dev="/dev/sdg"/>
Aug 09 01:09:32 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:09:32 user nova-compute[72780]:   <serial>a0170af5-fdaa-4008-82fe-81a271776cd5</serial>
Aug 09 01:09:32 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 01:09:32 user nova-compute[72780]: </disk>
Aug 09 01:09:32 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543372.7090433, 006a70f2-b9aa-47eb-b885-8f9e68926cca => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:09:32 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Successfully detached device vdc from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the live domain config.
Aug 09 01:09:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'asihMnDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:09:32 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6659945-f22f-40aa-acf4-b3dc3574fac3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5a0e4-5da1-4086-b3d6-3d51ef9e9a3c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 (non-flash)
Aug 09 01:09:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa07e92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5'): ({'sdg'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Removing single pathed devices sdg {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3475d61-b945-4b24-94cb-b6aa4899efef]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac851b4-476f-476c-9e8c-f9eadbcc8d47]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Flushing IO for device /dev/sdg {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7394668-db81-463d-9e08-c00ef9797581]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7104d-950e-4bd9-8fba-f6b6a8cebf1d]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] SCSI volumes sdg have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac2ad88-c228-48ec-82af-35018f57d674]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9207c871-bddf-43c6-8f5c-a83208f1d2e2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260]
Aug 09 01:09:32 user nova-compute[72780]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5, portal: 172.16.0.220,3260] successful.
Aug 09 01:09:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0170af5-fdaa-4008-82fe-81a271776cd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb81d76-a4e2-4dbd-ba97-cd67cdc149d3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] <== disconnect_volume: return (311ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'flavor' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:09:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-fe32d589-ee3e-44e7-8a2f-dedc466c540d tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.554s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:09:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:37 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543362.511967, eef82018-54b7-471d-bee1-45bf26de56e1 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:09:37 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] VM Stopped (Lifecycle Event)
Aug 09 01:09:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-47540a65-809b-4794-a537-b97de9874c7e None None] [instance: eef82018-54b7-471d-bee1-45bf26de56e1] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:09:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:09:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:09:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-changed-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:02 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Refreshing instance network info cache due to event network-changed-569811ea-ca1d-427f-be17-e7a8b8d47ba3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:10:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] Acquiring lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:10:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] Acquired lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:10:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Refreshing network info cache for port 569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updated VIF entry in instance network info cache for port 569811ea-ca1d-427f-be17-e7a8b8d47ba3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updating instance_info_cache with network_info: [{"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c2476a4-685d-472a-a51a-1c5e14a8f7b4 req-dda87d3d-46c3-48ff-871d-7614c36713fb service nova] Releasing lock "refresh_cache-dcd7e878-0475-4004-8a45-c15f405e0883" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-changed-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Refreshing instance network info cache due to event network-changed-dd27cae1-6be6-4fbb-96d4-9171c7f5643f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] Acquiring lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] Acquired lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Refreshing network info cache for port dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updated VIF entry in instance network info cache for port dd27cae1-6be6-4fbb-96d4-9171c7f5643f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updating instance_info_cache with network_info: [{"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:03 user nova-compute[72780]: INFO nova.compute.manager [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Terminating instance
Aug 09 01:10:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-60a70f1f-8499-4365-a706-ca8859c983bb req-9f8f288a-3613-4171-8131-ec0b3adb470a service nova] Releasing lock "refresh_cache-eba7383a-8b23-4c07-a628-8a5db60b2e20" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Instance destroyed successfully.
Aug 09 01:10:04 user nova-compute[72780]: DEBUG nova.objects.instance [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'resources' on Instance uuid eba7383a-8b23-4c07-a628-8a5db60b2e20 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1047171170',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1047171170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1047171170',id=36,image_ref='cbdfc500-8098-48dd-9c13-edea74cd5398',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKgAV/KYQjGcZl7zIECvbDog15N3h5ujgQG6YJmEUU/usp1r+f/t0LlNt/l6TUs8qoJIMVwZE1wur4zqxN6H8ClvWDDgZyBja2paap+UP9h2aPO10Id637QKgvAIkRwcQ==',key_name='tempest-keypair-986777708',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:08:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-khrqy83c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1708118170',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54101aceab04126ba338c9965790cf3',uuid=eba7383a-8b23-4c07-a628-8a5db60b2e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "address": "fa:16:3e:95:89:de", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd27cae1-6b", "ovs_interfaceid": "dd27cae1-6be6-4fbb-96d4-9171c7f5643f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_vif [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd27cae1-6b, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:04 user nova-compute[72780]: INFO os_vif [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:89:de,bridge_name='br-int',has_traffic_filtering=True,id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd27cae1-6b')
Aug 09 01:10:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrcbzAZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:04 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[220851bc-4683-4182-84ea-712d30c5a77b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc1e4f-6b3f-458c-a117-d6e235fb862e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:04 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ad81749d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caab8e8-fe20-4a57-a510-65433f0a0b6e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dbb610-89f2-4520-a7f7-d63cce735a6c]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[158c862c-91c6-414f-996d-0917147870d8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce488460-ce61-4f8a-a320-284225eeb552]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26630623737383766', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_641f99c', '/dev/disk/by-id/scsi-1SCST_BIO641f99c-f0b7787f071ea2c1') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8284c8c-6be8-4eb2-9664-9cee0487b867]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2895de26-5b84-4cae-bdf1-c9dedc3c679a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a0e00-0811-4d72-8f72-55b2123db1db]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260]
Aug 09 01:10:04 user nova-compute[72780]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:04 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26733be9-ff1e-4e56-8daa-8171528168b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5b20d-cb8d-420a-b727-0f9ba6277955]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== disconnect_volume: return (332ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Deleting instance files /opt/stack/data/nova/instances/eba7383a-8b23-4c07-a628-8a5db60b2e20_del
Aug 09 01:10:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Deletion of /opt/stack/data/nova/instances/eba7383a-8b23-4c07-a628-8a5db60b2e20_del complete
Aug 09 01:10:05 user nova-compute[72780]: INFO nova.compute.manager [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-vif-unplugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] No waiting events found dispatching network-vif-unplugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-vif-unplugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] Acquiring lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] No waiting events found dispatching network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:05 user nova-compute[72780]: WARNING nova.compute.manager [req-3037c677-023f-4a09-a57c-9dc76b00843f req-728119dc-fddf-4221-87c3-5cb9b00740ee service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received unexpected event network-vif-plugged-dd27cae1-6be6-4fbb-96d4-9171c7f5643f for instance with vm_state active and task_state deleting.
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-32b4097e-0b45-41ed-873b-b0062234d9da req-fcd168e6-0df6-46a7-a185-11c6c03076e4 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Received event network-vif-deleted-dd27cae1-6be6-4fbb-96d4-9171c7f5643f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:05 user nova-compute[72780]: INFO nova.compute.manager [req-32b4097e-0b45-41ed-873b-b0062234d9da req-fcd168e6-0df6-46a7-a185-11c6c03076e4 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Neutron deleted interface dd27cae1-6be6-4fbb-96d4-9171c7f5643f; detaching it from the instance and deleting it from the info cache
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-32b4097e-0b45-41ed-873b-b0062234d9da req-fcd168e6-0df6-46a7-a185-11c6c03076e4 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:05 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Took 0.84 seconds to deallocate network for instance.
Aug 09 01:10:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-32b4097e-0b45-41ed-873b-b0062234d9da req-fcd168e6-0df6-46a7-a185-11c6c03076e4 service nova] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Detach interface failed, port_id=dd27cae1-6be6-4fbb-96d4-9171c7f5643f, reason: Instance eba7383a-8b23-4c07-a628-8a5db60b2e20 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:06 user nova-compute[72780]: INFO nova.compute.manager [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Attaching volume 8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 to /dev/vdb
Aug 09 01:10:06 user nova-compute[72780]: DEBUG os_brick.utils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fabfc8e-f129-48f8-81f3-8d493749c91f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:06 user nova-compute[72780]: INFO nova.compute.manager [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 01:10:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Deleting volume: 26733be9-ff1e-4e56-8daa-8171528168b4 {{(pid=72780) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d491a-c41a-4a7a-94f3-1f27a1796f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ead1a6-77f4-4d5b-b32a-2b9bf03b244b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b570a4-d6b0-44a2-8100-9e8f1f37ce08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:10:06 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3db225-50ca-4f1f-bb1f-224d6bb8236a]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG os_brick.utils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updating existing volume attachment record: ac4611c1-6741-4298-84ba-29bfb67ba7f9 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:07 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:10:07 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:10:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:07 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Deleted allocations for instance eba7383a-8b23-4c07-a628-8a5db60b2e20
Aug 09 01:10:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-bff36b43-33be-4e9e-85ca-9a77b16916fc tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "eba7383a-8b23-4c07-a628-8a5db60b2e20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.315s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:12 user nova-compute[72780]: INFO nova.compute.manager [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Terminating instance
Aug 09 01:10:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-c8881e2c-93e9-456c-b80b-24641b0b0556 req-f08be7db-9750-48fb-b449-960bda6fc827 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c8881e2c-93e9-456c-b80b-24641b0b0556 req-f08be7db-9750-48fb-b449-960bda6fc827 service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c8881e2c-93e9-456c-b80b-24641b0b0556 req-f08be7db-9750-48fb-b449-960bda6fc827 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c8881e2c-93e9-456c-b80b-24641b0b0556 req-f08be7db-9750-48fb-b449-960bda6fc827 service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-c8881e2c-93e9-456c-b80b-24641b0b0556 req-f08be7db-9750-48fb-b449-960bda6fc827 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-c8881e2c-93e9-456c-b80b-24641b0b0556 req-f08be7db-9750-48fb-b449-960bda6fc827 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-unplugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:10:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Instance destroyed successfully.
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'resources' on Instance uuid a76eeaad-0c42-45c7-8351-a3dacdad0574 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:54:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1627471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1627471',id=12,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-50pggjcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:58:13Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=a76eeaad-0c42-45c7-8351-a3dacdad0574,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "address": "fa:16:3e:dd:38:66", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fedb901-86", "ovs_interfaceid": "6fedb901-867a-4ae8-80c4-1da838b3e44e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_vif [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fedb901-86, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:13 user nova-compute[72780]: INFO os_vif [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:38:66,bridge_name='br-int',has_traffic_filtering=True,id=6fedb901-867a-4ae8-80c4-1da838b3e44e,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fedb901-86')
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfITxHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:13 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa1331-d003-4849-958f-ca5ddfb9f4a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[26140c7b-7aa0-40a1-9a5b-1b669aeeb43f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:13 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01ae950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f'): ({'sdi'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Removing single pathed devices sdi {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250b019-bda7-4768-81d8-97a5bfee5cb4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b1bf5-a1a8-4ca1-a85f-fb2f626207f1]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Flushing IO for device /dev/sdi {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab74b35-8afe-4423-adf1-a6e1b723b344]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee31e8b-9bea-41b9-bbdc-a698f9c518ca]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] SCSI volumes sdi have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab1f34-14c1-40fa-8352-40b605c32ba2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b04bd8-19d0-4b5e-b182-888d227c6a72]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260]
Aug 09 01:10:13 user nova-compute[72780]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e76589-9c1b-45b8-8b1b-28007ff9400f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef9088-4c5a-4ce6-b944-0ae01be93dd0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] <== disconnect_volume: return (276ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Deleting instance files /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574_del
Aug 09 01:10:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Deletion of /opt/stack/data/nova/instances/a76eeaad-0c42-45c7-8351-a3dacdad0574_del complete
Aug 09 01:10:13 user nova-compute[72780]: INFO nova.compute.manager [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 09 01:10:13 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:10:13 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:10:14 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:14 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Took 0.50 seconds to deallocate network for instance.
Aug 09 01:10:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-388011ca-7ddb-4e45-862e-73ad68622e39 req-c757fcf1-9b32-424f-8433-891a6d950168 service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-deleted-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:14 user nova-compute[72780]: INFO nova.compute.manager [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Took 0.71 seconds to detach 1 volumes for instance.
Aug 09 01:10:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-dfdef4f8-6f59-4872-b6bd-dd919a53c2ed req-34c220f3-b56b-407c-bb00-8eb5f95dd4cd service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dfdef4f8-6f59-4872-b6bd-dd919a53c2ed req-34c220f3-b56b-407c-bb00-8eb5f95dd4cd service nova] Acquiring lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dfdef4f8-6f59-4872-b6bd-dd919a53c2ed req-34c220f3-b56b-407c-bb00-8eb5f95dd4cd service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-dfdef4f8-6f59-4872-b6bd-dd919a53c2ed req-34c220f3-b56b-407c-bb00-8eb5f95dd4cd service nova] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-dfdef4f8-6f59-4872-b6bd-dd919a53c2ed req-34c220f3-b56b-407c-bb00-8eb5f95dd4cd service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] No waiting events found dispatching network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:15 user nova-compute[72780]: WARNING nova.compute.manager [req-dfdef4f8-6f59-4872-b6bd-dd919a53c2ed req-34c220f3-b56b-407c-bb00-8eb5f95dd4cd service nova] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Received unexpected event network-vif-plugged-6fedb901-867a-4ae8-80c4-1da838b3e44e for instance with vm_state deleted and task_state None.
Aug 09 01:10:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:15 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Deleted allocations for instance a76eeaad-0c42-45c7-8351-a3dacdad0574
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-53c93d4e-2ece-4e4c-9723-53ebf98bfdcf tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "a76eeaad-0c42-45c7-8351-a3dacdad0574" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcIiDYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:15 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:15 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[971015b7-80cc-4c46-81a9-215e45b87c29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:10:15 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff19ff0-b18d-495d-adae-f2f669f43d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3] added
Aug 09 01:10:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7baa6d-e2f4-4e55-b79d-702744588831]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3eeb93-5ef3-459b-981d-6c24bbc88761]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcIiDYtz {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcIiDYtz" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0ae66a-a41b-4233-b01a-c76264cc3f66]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hcIiDYtz'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef881f61-e46a-43dd-bdba-fbf4ca518033]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf04743-da35-4261-8401-b927c6929b4b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:15 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:15 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:15 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:15 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:15 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:15 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a22886-c4ba-47ea-a062-cb7e0a2ec6b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260]
Aug 09 01:10:15 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:15 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bcc03d-c302-4c6f-a208-fafca4310fec]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad3a36-7dc4-49f9-9849-5eefaf21a257]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 (non-flash)
Aug 09 01:10:16 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4051a-4c50-4f75-929b-590d2eb3c7af]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:10:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcIiDYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23039626664393538', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039626664393538', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:10:17 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:10:17 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:10:17 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:10:17 user nova-compute[72780]:   <serial>8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3</serial>
Aug 09 01:10:17 user nova-compute[72780]: </disk>
Aug 09 01:10:17 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] No VIF found with MAC fa:16:3e:2a:7d:dc, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:10:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c677c53b-c9aa-4658-bde6-8b711d446fb9 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.079s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:19 user nova-compute[72780]: INFO nova.compute.manager [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Detaching volume 8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3
Aug 09 01:10:19 user nova-compute[72780]: INFO nova.virt.block_device [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Attempting to driver detach volume 8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 from mountpoint /dev/vdb
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Attempting to detach device vdb from instance dcd7e878-0475-4004-8a45-c15f405e0883 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:10:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:10:19 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:10:19 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:10:19 user nova-compute[72780]:   <serial>8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3</serial>
Aug 09 01:10:19 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:10:19 user nova-compute[72780]: </disk>
Aug 09 01:10:19 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:10:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully detached device vdb from instance dcd7e878-0475-4004-8a45-c15f405e0883 from the persistent domain config.
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcd7e878-0475-4004-8a45-c15f405e0883 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:10:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:10:19 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:10:19 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:10:19 user nova-compute[72780]:   <serial>8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3</serial>
Aug 09 01:10:19 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:10:19 user nova-compute[72780]: </disk>
Aug 09 01:10:19 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543419.5913537, dcd7e878-0475-4004-8a45-c15f405e0883 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:10:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully detached device vdb from instance dcd7e878-0475-4004-8a45-c15f405e0883 from the live domain config.
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcIiDYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543404.6101294, eba7383a-8b23-4c07-a628-8a5db60b2e20 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:10:19 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] VM Stopped (Lifecycle Event)
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[64906b08-5a17-4d59-bda8-9811777b3880]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-34368d70-55c9-4684-b3af-5edcedf6b0fe None None] [instance: eba7383a-8b23-4c07-a628-8a5db60b2e20] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2430c5-1abb-4c9a-99b3-5778a66ef26a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 (non-flash)
Aug 09 01:10:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ad82c9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e5f535-cfd8-4daa-9e7c-67b31c9b5709]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc2474-4381-4f65-9018-7c39409f9401]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3011c9-157c-432a-88d8-6073b7261469]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff5f4c6-1c32-416e-9155-d6ed2b80f47f]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae7213c-0a9b-49d3-8c49-e3f57949877e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5f069-4e8b-40c9-b1b3-224344b66536]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260]
Aug 09 01:10:19 user nova-compute[72780]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbdea65-dc90-4d31-aa20-6f8d9e4dbba3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0861f-1883-4c31-b0ed-cf0b040a7f71]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] <== disconnect_volume: return (305ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'flavor' on Instance uuid dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b114ae8-750a-4fb3-a140-b67fb1ebbc95 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:22 user nova-compute[72780]: INFO nova.compute.manager [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Detaching volume 5051731a-5879-443c-81b4-efef84d9a551
Aug 09 01:10:22 user nova-compute[72780]: INFO nova.virt.block_device [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Attempting to driver detach volume 5051731a-5879-443c-81b4-efef84d9a551 from mountpoint /dev/vdb
Aug 09 01:10:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Attempting to detach device vdb from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:10:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:10:22 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:10:22 user nova-compute[72780]:   <source dev="/dev/sde"/>
Aug 09 01:10:22 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:10:22 user nova-compute[72780]:   <serial>5051731a-5879-443c-81b4-efef84d9a551</serial>
Aug 09 01:10:22 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:10:22 user nova-compute[72780]: </disk>
Aug 09 01:10:22 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:10:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Successfully detached device vdb from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the persistent domain config.
Aug 09 01:10:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:10:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:10:22 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:10:22 user nova-compute[72780]:   <source dev="/dev/sde"/>
Aug 09 01:10:22 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:10:22 user nova-compute[72780]:   <serial>5051731a-5879-443c-81b4-efef84d9a551</serial>
Aug 09 01:10:22 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:10:22 user nova-compute[72780]: </disk>
Aug 09 01:10:22 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543423.196373, 006a70f2-b9aa-47eb-b885-8f9e68926cca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:10:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Successfully detached device vdb from instance 006a70f2-b9aa-47eb-b885-8f9e68926cca from the live domain config.
Aug 09 01:10:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnACjSoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:23 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c597f3f-4c8c-4828-9fbb-c7557c5b473d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ddd08-6423-4579-830d-fb70b2d02683]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:23 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:23 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:23 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:23 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:23 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:23 user nova-compute[72780]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 (non-flash)
Aug 09 01:10:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ae3bb88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551'): ({'sde'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Removing single pathed devices sde {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e4738-2d30-4247-82a5-a39a81200151]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1eef4d-cb6d-4217-9d67-2cb04224f8b4]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Flushing IO for device /dev/sde {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[46070df5-2a86-49da-b733-c7a6b4ba3dc5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[964efbd2-f959-434c-9d2b-f9e949579601]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ab20f-76ff-4d0e-8087-27899aed0497]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce76be-d102-4268-9e3c-360e7f126bab]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260]
Aug 09 01:10:23 user nova-compute[72780]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:23 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5051731a-5879-443c-81b4-efef84d9a551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[596975cb-cad3-46b2-a366-92ef6a7f4725]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] <== disconnect_volume: return (261ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'flavor' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c4e541e3-7050-4ebe-ba98-6d1d619f5135 tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.113s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:26 user nova-compute[72780]: INFO nova.compute.manager [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Unrescuing
Aug 09 01:10:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:10:26 user nova-compute[72780]: DEBUG nova.network.neutron [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG nova.network.neutron [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG nova.objects.instance [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'flavor' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-07f3adc2-e232-40e4-bdd3-2cd1ee1fff2b req-f681a44b-c48e-4a1d-95c0-162ebb048eb4 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07f3adc2-e232-40e4-bdd3-2cd1ee1fff2b req-f681a44b-c48e-4a1d-95c0-162ebb048eb4 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07f3adc2-e232-40e4-bdd3-2cd1ee1fff2b req-f681a44b-c48e-4a1d-95c0-162ebb048eb4 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-07f3adc2-e232-40e4-bdd3-2cd1ee1fff2b req-f681a44b-c48e-4a1d-95c0-162ebb048eb4 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG nova.compute.manager [req-07f3adc2-e232-40e4-bdd3-2cd1ee1fff2b req-f681a44b-c48e-4a1d-95c0-162ebb048eb4 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:27 user nova-compute[72780]: WARNING nova.compute.manager [req-07f3adc2-e232-40e4-bdd3-2cd1ee1fff2b req-f681a44b-c48e-4a1d-95c0-162ebb048eb4 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:10:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance destroyed successfully.
Aug 09 01:10:28 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543413.2699368, a76eeaad-0c42-45c7-8351-a3dacdad0574 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:10:28 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] VM Stopped (Lifecycle Event)
Aug 09 01:10:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8e7aef55-41f9-4a28-9c33-a6f598a3b064 None None] [instance: a76eeaad-0c42-45c7-8351-a3dacdad0574] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:10:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:29 user nova-compute[72780]: WARNING nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing instance network info cache due to event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updated VIF entry in instance network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing instance network info cache due to event network-changed-d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Acquiring lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Acquired lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Refreshing network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updated VIF entry in instance network info cache for port d51c0ac4-c7b3-4865-a20f-838a2a837956. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [{"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Releasing lock "refresh_cache-61c9d542-625d-4683-8b61-291c47d1fa91" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:30 user nova-compute[72780]: WARNING nova.compute.manager [req-a27f84c6-6fce-46b0-bf89-d4d9e4251ede req-bbdd9bef-5a89-4e45-9fbe-62f8d72fa988 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for 61c9d542-625d-4683-8b61-291c47d1fa91 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543431.3858385, 61c9d542-625d-4683-8b61-291c47d1fa91 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:10:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Resumed (Lifecycle Event)
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-de374f0d-428b-4043-bd61-821cd013a1ae tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:10:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:10:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7890MB free_disk=25.01665496826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-f00606bf-ea51-499f-a3c2-88dca12f78d6 req-cc83cb06-43b2-4e99-9ba0-3a91776e6328 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f00606bf-ea51-499f-a3c2-88dca12f78d6 req-cc83cb06-43b2-4e99-9ba0-3a91776e6328 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f00606bf-ea51-499f-a3c2-88dca12f78d6 req-cc83cb06-43b2-4e99-9ba0-3a91776e6328 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f00606bf-ea51-499f-a3c2-88dca12f78d6 req-cc83cb06-43b2-4e99-9ba0-3a91776e6328 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-f00606bf-ea51-499f-a3c2-88dca12f78d6 req-cc83cb06-43b2-4e99-9ba0-3a91776e6328 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:31 user nova-compute[72780]: WARNING nova.compute.manager [req-f00606bf-ea51-499f-a3c2-88dca12f78d6 req-cc83cb06-43b2-4e99-9ba0-3a91776e6328 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:10:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543431.3866844, 61c9d542-625d-4683-8b61-291c47d1fa91 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:10:31 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Started (Lifecycle Event)
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 82b3d395-7aec-4312-8bdd-50a84e8f3830 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 006a70f2-b9aa-47eb-b885-8f9e68926cca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance dcd7e878-0475-4004-8a45-c15f405e0883 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:10:31 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:10:32 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:10:32 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:10:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:10:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:10:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:10:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:10:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:10:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:10:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-changed-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Refreshing instance network info cache due to event network-changed-e4236ae9-35df-4fb2-92e2-8908dc00cdd9. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:10:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] Acquiring lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:10:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] Acquired lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:10:54 user nova-compute[72780]: DEBUG nova.network.neutron [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Refreshing network info cache for port e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updated VIF entry in instance network info cache for port e4236ae9-35df-4fb2-92e2-8908dc00cdd9. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating instance_info_cache with network_info: [{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b9ceb08-f227-425d-96ae-98878a27d376 req-1fcfefb3-2982-4833-99f0-6a44214a96d5 service nova] Releasing lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:10:55 user nova-compute[72780]: INFO nova.compute.manager [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Rebuilding instance
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'resources' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'migration_context' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72780) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-52047d49-24a7-49ad-ad4e-5cdbc73b8eb2 req-5f8279e8-75a2-4572-9d20-9108645c9b67 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-52047d49-24a7-49ad-ad4e-5cdbc73b8eb2 req-5f8279e8-75a2-4572-9d20-9108645c9b67 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-52047d49-24a7-49ad-ad4e-5cdbc73b8eb2 req-5f8279e8-75a2-4572-9d20-9108645c9b67 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-52047d49-24a7-49ad-ad4e-5cdbc73b8eb2 req-5f8279e8-75a2-4572-9d20-9108645c9b67 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-52047d49-24a7-49ad-ad4e-5cdbc73b8eb2 req-5f8279e8-75a2-4572-9d20-9108645c9b67 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:55 user nova-compute[72780]: WARNING nova.compute.manager [req-52047d49-24a7-49ad-ad4e-5cdbc73b8eb2 req-5f8279e8-75a2-4572-9d20-9108645c9b67 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state rebuilding.
Aug 09 01:10:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance destroyed successfully.
Aug 09 01:10:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance destroyed successfully.
Aug 09 01:10:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-701238868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1890691155',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwqtgwy2TT9KcvouviRj8PUBjCw3OhwSi4n7Zob4lglKVdHHrd8lvhPzfTAAe1qzH1pBuNK9oqDnfgUziMnK5qU/yF13yQEfIt+GZ3tI19B/wS3/2cK3+8/yFESYALC4w==',key_name='tempest-keypair-385507197',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='040b6f9693f942fe9cf0fbce3d015e29',ramdisk_id='',reservation_id='r-i3ic35y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2020741728',owner_user_name='tempest-ServerActionsV293TestJSON-2020741728-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a94bf4a8aa224f5e8568d1bd4be408f5',uuid=5b8a7c86-1bdf-4cf9-8064-a2505c9b2366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converting VIF {"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4236ae9-35, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:56 user nova-compute[72780]: INFO os_vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35')
Aug 09 01:10:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:56 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d83aea-7583-482a-a4f0-e2fa29f8ab27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[240fa8eb-e332-4f50-bd21-1b06c9d95f3a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:56 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:56 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:56 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:56 user nova-compute[72780]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:10:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06ba3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35cb96-49fb-4704-99dc-7139130ececb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a90b15-6fcf-4690-ab67-31a64daa9463]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5ca90-a2da-422d-8f8a-a7720219d3ee]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816af77-9729-47a0-949c-f7ab19b7003a]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1550006-3a2b753bd09df6fc', '/dev/disk/by-id/scsi-23361326237353362', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1550006') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1811c7e-c859-4b8d-97d2-efa45c053d28]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b13fe6-bc63-4f40-9709-21b890c1682a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec577d1-dfe2-4437-8b28-eccf7b611df8]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]
Aug 09 01:10:56 user nova-compute[72780]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29f9bed-8227-4f0d-a186-cdd819972162]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== disconnect_volume: return (307ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Deleting instance files /opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366_del
Aug 09 01:10:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Deletion of /opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366_del complete
Aug 09 01:10:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 could not be found.
Aug 09 01:10:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:56 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[248304d3-46d9-4a18-8c4d-fbdcd2440262]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36495d17-cb8f-46da-a6cb-80149cd45259]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:56 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:56 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:56 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06da830>, {}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Disconnecting from: [] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== disconnect_volume: return (58ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-d3d301eb-b2c1-4df0-a43c-bddb1116dc0c req-b10d2df4-6111-45fa-b1d6-86babafc48bd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d3d301eb-b2c1-4df0-a43c-bddb1116dc0c req-b10d2df4-6111-45fa-b1d6-86babafc48bd service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d3d301eb-b2c1-4df0-a43c-bddb1116dc0c req-b10d2df4-6111-45fa-b1d6-86babafc48bd service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d3d301eb-b2c1-4df0-a43c-bddb1116dc0c req-b10d2df4-6111-45fa-b1d6-86babafc48bd service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-d3d301eb-b2c1-4df0-a43c-bddb1116dc0c req-b10d2df4-6111-45fa-b1d6-86babafc48bd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:57 user nova-compute[72780]: WARNING nova.compute.manager [req-d3d301eb-b2c1-4df0-a43c-bddb1116dc0c req-b10d2df4-6111-45fa-b1d6-86babafc48bd service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state rebuilding.
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:58 user nova-compute[72780]: INFO nova.compute.manager [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Terminating instance
Aug 09 01:10:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-f1fec3e8-f500-4ab5-be4b-f2d7be9e1e2a req-7e533748-496f-4dcd-bb08-08c03fe87610 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-vif-unplugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f1fec3e8-f500-4ab5-be4b-f2d7be9e1e2a req-7e533748-496f-4dcd-bb08-08c03fe87610 service nova] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f1fec3e8-f500-4ab5-be4b-f2d7be9e1e2a req-7e533748-496f-4dcd-bb08-08c03fe87610 service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f1fec3e8-f500-4ab5-be4b-f2d7be9e1e2a req-7e533748-496f-4dcd-bb08-08c03fe87610 service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-f1fec3e8-f500-4ab5-be4b-f2d7be9e1e2a req-7e533748-496f-4dcd-bb08-08c03fe87610 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] No waiting events found dispatching network-vif-unplugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:10:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-f1fec3e8-f500-4ab5-be4b-f2d7be9e1e2a req-7e533748-496f-4dcd-bb08-08c03fe87610 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-vif-unplugged-072b2587-415f-4c16-b677-30d737fb021d for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Preparing to wait for external event volume-reimaged-be5328c3-a649-47d0-9365-284accb9ec38 {{(pid=72780) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Instance destroyed successfully.
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'resources' on Instance uuid 82b3d395-7aec-4312-8bdd-50a84e8f3830 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-864232018',display_name='tempest-TestVolumeBootPattern-volume-backed-server-864232018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-864232018',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnVo78fm51DcK+haWyMf6CHs8VbGE65tH9fd3eFyjEiTaUy+yM8C2l43GLukDhwRiraCYWz7Az6KRZYLuE8AdVSD0YAGRFPtZlTsbYln48neVw5dhUpvMr4yJm6Mwd/3Q==',key_name='tempest-keypair-1022615801',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-83abk4xc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54101aceab04126ba338c9965790cf3',uuid=82b3d395-7aec-4312-8bdd-50a84e8f3830,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "072b2587-415f-4c16-b677-30d737fb021d", "address": "fa:16:3e:03:72:66", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072b2587-41", "ovs_interfaceid": "072b2587-415f-4c16-b677-30d737fb021d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_vif [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap072b2587-41, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:10:59 user nova-compute[72780]: INFO os_vif [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:72:66,bridge_name='br-int',has_traffic_filtering=True,id=072b2587-415f-4c16-b677-30d737fb021d,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072b2587-41')
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiGdELAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:10:59 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb33135-62bc-4973-9cff-8ac5949b21bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d313b2e0-394a-427c-8bda-9dbe82eb9dd9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:59 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b (non-flash)
Aug 09 01:10:59 user nova-compute[72780]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:10:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ae0de77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b'): ({'sdf'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Removing single pathed devices sdf {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f8885e-a97a-4b26-8725-a410dcbfedb9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7943c1c5-7f24-4532-947c-c5f49e4d9e84]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flushing IO for device /dev/sdf {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab215352-afb6-481c-ba53-82803b047168]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07d77b-e3c4-4199-9ebb-096eec3c81b5]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] SCSI volumes sdf have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[be88d063-23f6-410f-bb7f-3372ebec61d9]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe550cd-fa2e-4ac4-8124-a7b54d75cb67]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260]
Aug 09 01:10:59 user nova-compute[72780]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b, portal: 172.16.0.220,3260] successful.
Aug 09 01:10:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecb3695b-c8c1-43ce-87e7-ec115618264b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd2f7e1-bd8a-46b4-8cab-fe5cfb55130a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== disconnect_volume: return (275ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:10:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Deleting instance files /opt/stack/data/nova/instances/82b3d395-7aec-4312-8bdd-50a84e8f3830_del
Aug 09 01:10:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Deletion of /opt/stack/data/nova/instances/82b3d395-7aec-4312-8bdd-50a84e8f3830_del complete
Aug 09 01:10:59 user nova-compute[72780]: INFO nova.compute.manager [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 09 01:10:59 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:10:59 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:00 user nova-compute[72780]: INFO nova.compute.manager [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Detaching volume b52b6a9c-9fc7-4e10-a9cd-312c56ae0953
Aug 09 01:11:00 user nova-compute[72780]: INFO nova.virt.block_device [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Attempting to driver detach volume b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 from mountpoint /dev/vdb
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Attempting to detach device vdb from instance 61c9d542-625d-4683-8b61-291c47d1fa91 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:11:00 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:11:00 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:11:00 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:11:00 user nova-compute[72780]:   <serial>b52b6a9c-9fc7-4e10-a9cd-312c56ae0953</serial>
Aug 09 01:11:00 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:11:00 user nova-compute[72780]: </disk>
Aug 09 01:11:00 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:11:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Successfully detached device vdb from instance 61c9d542-625d-4683-8b61-291c47d1fa91 from the persistent domain config.
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61c9d542-625d-4683-8b61-291c47d1fa91 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:11:00 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:11:00 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:11:00 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:11:00 user nova-compute[72780]:   <serial>b52b6a9c-9fc7-4e10-a9cd-312c56ae0953</serial>
Aug 09 01:11:00 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:11:00 user nova-compute[72780]: </disk>
Aug 09 01:11:00 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-50b3242c-2482-4df2-a1b0-96eb4df9e8c7 req-83e5791b-b739-48d6-9ab9-e89db48ce6e5 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-50b3242c-2482-4df2-a1b0-96eb4df9e8c7 req-83e5791b-b739-48d6-9ab9-e89db48ce6e5 service nova] Acquiring lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-50b3242c-2482-4df2-a1b0-96eb4df9e8c7 req-83e5791b-b739-48d6-9ab9-e89db48ce6e5 service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-50b3242c-2482-4df2-a1b0-96eb4df9e8c7 req-83e5791b-b739-48d6-9ab9-e89db48ce6e5 service nova] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-50b3242c-2482-4df2-a1b0-96eb4df9e8c7 req-83e5791b-b739-48d6-9ab9-e89db48ce6e5 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] No waiting events found dispatching network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:00 user nova-compute[72780]: WARNING nova.compute.manager [req-50b3242c-2482-4df2-a1b0-96eb4df9e8c7 req-83e5791b-b739-48d6-9ab9-e89db48ce6e5 service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received unexpected event network-vif-plugged-072b2587-415f-4c16-b677-30d737fb021d for instance with vm_state active and task_state deleting.
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543460.9918368, 61c9d542-625d-4683-8b61-291c47d1fa91 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:11:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:11:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Successfully detached device vdb from instance 61c9d542-625d-4683-8b61-291c47d1fa91 from the live domain config.
Aug 09 01:11:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'galzmefW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:11:01 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c5507-8f3f-4868-9a99-d61ff0780374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f736d-676c-443e-a626-7d21151e3a5e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:11:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 (non-flash)
Aug 09 01:11:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06b8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[37446065-ef1e-471d-950c-f603a27ee92e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2249d130-15a6-4872-8f95-80ef65c21fdf]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Took 1.35 seconds to deallocate network for instance.
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a458b85-b1a1-455d-8fef-6970e2d51370]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-a8bae7ac-b3ea-4311-9d87-30571b1a456e req-90c9678c-d45d-4bb5-93fa-8008d4bc020c service nova] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Received event network-vif-deleted-072b2587-415f-4c16-b677-30d737fb021d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da66ef3-1063-4213-9f6b-5ab5dadf4d19]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87cfb85-d59e-45d3-9ab4-02f51956eec7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef7a92-dd85-4681-a88a-61e2f0fbea3d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260]
Aug 09 01:11:01 user nova-compute[72780]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953, portal: 172.16.0.220,3260] successful.
Aug 09 01:11:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52b6a9c-9fc7-4e10-a9cd-312c56ae0953 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c26eb-5a55-43eb-a3c8-5aa9750d31c5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] <== disconnect_volume: return (304ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:11:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:11:02 user nova-compute[72780]: INFO nova.compute.manager [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Took 0.89 seconds to detach 1 volumes for instance.
Aug 09 01:11:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Deleting volume: ecb3695b-c8c1-43ce-87e7-ec115618264b {{(pid=72780) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 01:11:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:02 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:11:02 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:11:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:02 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Deleted allocations for instance 82b3d395-7aec-4312-8bdd-50a84e8f3830
Aug 09 01:11:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-baf34e78-132e-4ea8-a3c0-d8bd0e7d1542 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "82b3d395-7aec-4312-8bdd-50a84e8f3830" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.843s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:03 user nova-compute[72780]: INFO nova.compute.manager [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Terminating instance
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-b06f529b-2c26-449a-b1bc-ffa49ebf56e8 req-5c254399-4009-4177-a295-0df2c93ded7b service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-vif-unplugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b06f529b-2c26-449a-b1bc-ffa49ebf56e8 req-5c254399-4009-4177-a295-0df2c93ded7b service nova] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b06f529b-2c26-449a-b1bc-ffa49ebf56e8 req-5c254399-4009-4177-a295-0df2c93ded7b service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b06f529b-2c26-449a-b1bc-ffa49ebf56e8 req-5c254399-4009-4177-a295-0df2c93ded7b service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-b06f529b-2c26-449a-b1bc-ffa49ebf56e8 req-5c254399-4009-4177-a295-0df2c93ded7b service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] No waiting events found dispatching network-vif-unplugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-b06f529b-2c26-449a-b1bc-ffa49ebf56e8 req-5c254399-4009-4177-a295-0df2c93ded7b service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-vif-unplugged-3b83895c-c78a-4760-87f4-8027547ed305 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:11:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Instance destroyed successfully.
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lazy-loading 'resources' on Instance uuid 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T00:51:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591088295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591088295',id=3,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T00:51:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d09b1579894f47877a117276c7465f',ramdisk_id='',reservation_id='r-300tr7qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T00:53:21Z,user_data=None,user_id='4c93725c6c7e4001b478b1c87d6ba759',uuid=81f5333f-3c4f-4eb7-a1f5-65fd712ee84d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converting VIF {"id": "3b83895c-c78a-4760-87f4-8027547ed305", "address": "fa:16:3e:5e:44:de", "network": {"id": "82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1110786653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d09b1579894f47877a117276c7465f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b83895c-c7", "ovs_interfaceid": "3b83895c-c78a-4760-87f4-8027547ed305", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG os_vif [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b83895c-c7, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:03 user nova-compute[72780]: INFO os_vif [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:44:de,bridge_name='br-int',has_traffic_filtering=True,id=3b83895c-c78a-4760-87f4-8027547ed305,network=Network(82c069f1-b6c6-4fc9-aa13-ea4b4cc432c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b83895c-c7')
Aug 09 01:11:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Deleting instance files /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d_del
Aug 09 01:11:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Deletion of /opt/stack/data/nova/instances/81f5333f-3c4f-4eb7-a1f5-65fd712ee84d_del complete
Aug 09 01:11:04 user nova-compute[72780]: INFO nova.compute.manager [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 01:11:04 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:11:04 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:11:04 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:11:04 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:04 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Took 0.58 seconds to deallocate network for instance.
Aug 09 01:11:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-83c91af3-b9d9-46d7-a605-1cd0666021d6 req-609b20b4-b315-4298-b496-34407d45804c service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-vif-deleted-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:04 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:05 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Deleted allocations for instance 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d
Aug 09 01:11:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0b2d0ddf-449f-4351-b432-562bf8e34749 tempest-ServerBootFromVolumeStableRescueTest-1823004913 tempest-ServerBootFromVolumeStableRescueTest-1823004913-project-member] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-5c57b562-1afd-4ebc-9e37-35dc7a6d53c1 req-06a01026-b8df-4954-828b-b4669cdbf157 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received event network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5c57b562-1afd-4ebc-9e37-35dc7a6d53c1 req-06a01026-b8df-4954-828b-b4669cdbf157 service nova] Acquiring lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5c57b562-1afd-4ebc-9e37-35dc7a6d53c1 req-06a01026-b8df-4954-828b-b4669cdbf157 service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-5c57b562-1afd-4ebc-9e37-35dc7a6d53c1 req-06a01026-b8df-4954-828b-b4669cdbf157 service nova] Lock "81f5333f-3c4f-4eb7-a1f5-65fd712ee84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-5c57b562-1afd-4ebc-9e37-35dc7a6d53c1 req-06a01026-b8df-4954-828b-b4669cdbf157 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] No waiting events found dispatching network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:05 user nova-compute[72780]: WARNING nova.compute.manager [req-5c57b562-1afd-4ebc-9e37-35dc7a6d53c1 req-06a01026-b8df-4954-828b-b4669cdbf157 service nova] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Received unexpected event network-vif-plugged-3b83895c-c78a-4760-87f4-8027547ed305 for instance with vm_state deleted and task_state None.
Aug 09 01:11:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:07 user nova-compute[72780]: DEBUG nova.objects.instance [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'flavor' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-19c97ff2-0a9d-4bd4-80bb-d0c35cf2b340 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.117s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:09 user nova-compute[72780]: INFO nova.compute.manager [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Terminating instance
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-15a9c7df-4eec-484e-b09e-4c6609b804cd req-2b33c294-9d91-47b9-9ff3-b6140f0be773 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-vif-unplugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-15a9c7df-4eec-484e-b09e-4c6609b804cd req-2b33c294-9d91-47b9-9ff3-b6140f0be773 service nova] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-15a9c7df-4eec-484e-b09e-4c6609b804cd req-2b33c294-9d91-47b9-9ff3-b6140f0be773 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-15a9c7df-4eec-484e-b09e-4c6609b804cd req-2b33c294-9d91-47b9-9ff3-b6140f0be773 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-15a9c7df-4eec-484e-b09e-4c6609b804cd req-2b33c294-9d91-47b9-9ff3-b6140f0be773 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] No waiting events found dispatching network-vif-unplugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-15a9c7df-4eec-484e-b09e-4c6609b804cd req-2b33c294-9d91-47b9-9ff3-b6140f0be773 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-vif-unplugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:11:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Instance destroyed successfully.
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lazy-loading 'resources' on Instance uuid dcd7e878-0475-4004-8a45-c15f405e0883 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1811724090',display_name='tempest-AttachVolumeNegativeTest-server-1811724090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1811724090',id=35,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINVTik08fHgoR3kDaD3cbhfYahjAPXn7eYVGG92l+pHUIMtLMmRLGMANSVcxwkENZpdOefZXe7t3TplP8gN5pyMKvPvWCRhFvT2/aOj5WItQqzoVWzf1Ghck/PX64+jMg==',key_name='tempest-keypair-1501201909',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd0bd68653554fafa823eacae86e21a0',ramdisk_id='',reservation_id='r-8ofwyhko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1434038909',owner_user_name='tempest-AttachVolumeNegativeTest-1434038909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0456a39aaa64bdca5df6a3b67ea9d68',uuid=dcd7e878-0475-4004-8a45-c15f405e0883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converting VIF {"id": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "address": "fa:16:3e:2a:7d:dc", "network": {"id": "47fc1610-246e-43e5-8da2-4acc38666018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1604448703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd0bd68653554fafa823eacae86e21a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap569811ea-ca", "ovs_interfaceid": "569811ea-ca1d-427f-be17-e7a8b8d47ba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG os_vif [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap569811ea-ca, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:09 user nova-compute[72780]: INFO os_vif [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=569811ea-ca1d-427f-be17-e7a8b8d47ba3,network=Network(47fc1610-246e-43e5-8da2-4acc38666018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569811ea-ca')
Aug 09 01:11:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Deleting instance files /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883_del
Aug 09 01:11:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Deletion of /opt/stack/data/nova/instances/dcd7e878-0475-4004-8a45-c15f405e0883_del complete
Aug 09 01:11:10 user nova-compute[72780]: INFO nova.compute.manager [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 01:11:10 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:11:10 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:11:10 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:11 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Took 1.04 seconds to deallocate network for instance.
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-b62c1b13-e042-4ad1-9ad6-7dbe129738b9 req-5cdb5ce7-1ea7-4d4c-886e-9b545164bb2d service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-vif-deleted-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:11 user nova-compute[72780]: INFO nova.compute.manager [req-b62c1b13-e042-4ad1-9ad6-7dbe129738b9 req-5cdb5ce7-1ea7-4d4c-886e-9b545164bb2d service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Neutron deleted interface 569811ea-ca1d-427f-be17-e7a8b8d47ba3; detaching it from the instance and deleting it from the info cache
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.network.neutron [req-b62c1b13-e042-4ad1-9ad6-7dbe129738b9 req-5cdb5ce7-1ea7-4d4c-886e-9b545164bb2d service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-b62c1b13-e042-4ad1-9ad6-7dbe129738b9 req-5cdb5ce7-1ea7-4d4c-886e-9b545164bb2d service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Detach interface failed, port_id=569811ea-ca1d-427f-be17-e7a8b8d47ba3, reason: Instance dcd7e878-0475-4004-8a45-c15f405e0883 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:11 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Deleted allocations for instance dcd7e878-0475-4004-8a45-c15f405e0883
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543456.4078903, 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:11 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] VM Stopped (Lifecycle Event)
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-f2e0d506-0fda-4685-9bdf-5f9ac006eb37 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d439b926-c27a-4052-9901-e4f313200c52 tempest-AttachVolumeNegativeTest-1434038909 tempest-AttachVolumeNegativeTest-1434038909-project-member] Lock "dcd7e878-0475-4004-8a45-c15f405e0883" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-824c14a5-58ea-4448-9890-eea629baceb1 req-7e18e12f-94af-438a-9180-163def9256e2 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received event network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-824c14a5-58ea-4448-9890-eea629baceb1 req-7e18e12f-94af-438a-9180-163def9256e2 service nova] Acquiring lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-824c14a5-58ea-4448-9890-eea629baceb1 req-7e18e12f-94af-438a-9180-163def9256e2 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-824c14a5-58ea-4448-9890-eea629baceb1 req-7e18e12f-94af-438a-9180-163def9256e2 service nova] Lock "dcd7e878-0475-4004-8a45-c15f405e0883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:11 user nova-compute[72780]: DEBUG nova.compute.manager [req-824c14a5-58ea-4448-9890-eea629baceb1 req-7e18e12f-94af-438a-9180-163def9256e2 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] No waiting events found dispatching network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:11 user nova-compute[72780]: WARNING nova.compute.manager [req-824c14a5-58ea-4448-9890-eea629baceb1 req-7e18e12f-94af-438a-9180-163def9256e2 service nova] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Received unexpected event network-vif-plugged-569811ea-ca1d-427f-be17-e7a8b8d47ba3 for instance with vm_state deleted and task_state None.
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:13 user nova-compute[72780]: INFO nova.compute.manager [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Terminating instance
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-126d4964-f790-4a37-90aa-182500e93403 req-9b9a3986-e58a-4659-8f3b-61871b345992 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-vif-unplugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-126d4964-f790-4a37-90aa-182500e93403 req-9b9a3986-e58a-4659-8f3b-61871b345992 service nova] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-126d4964-f790-4a37-90aa-182500e93403 req-9b9a3986-e58a-4659-8f3b-61871b345992 service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-126d4964-f790-4a37-90aa-182500e93403 req-9b9a3986-e58a-4659-8f3b-61871b345992 service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-126d4964-f790-4a37-90aa-182500e93403 req-9b9a3986-e58a-4659-8f3b-61871b345992 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] No waiting events found dispatching network-vif-unplugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.compute.manager [req-126d4964-f790-4a37-90aa-182500e93403 req-9b9a3986-e58a-4659-8f3b-61871b345992 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-vif-unplugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:11:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Instance destroyed successfully.
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lazy-loading 'resources' on Instance uuid 006a70f2-b9aa-47eb-b885-8f9e68926cca {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1407073766',display_name='tempest-TestServerVolumeAttachmentScenario-server-1407073766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1407073766',id=34,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBTDG8yRM2PHcgNROrqTwszy3OYiXe9J3BxzWvtYc9eHHNfcNAMExLfE41MeuUWEWR4ht9P+idRq+YDFNvb41pvaZKudtec+tMndg1T2Jd8lo3DnGQyRiA35JfH/k8vMw==',key_name='tempest-keypair-23255615',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bebae52273848ebaa7ef0260df630d7',ramdisk_id='',reservation_id='r-0a3qfum5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1362148067',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1362148067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a84b071f368f433fb376d787d1abbca4',uuid=006a70f2-b9aa-47eb-b885-8f9e68926cca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Converting VIF {"id": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "address": "fa:16:3e:af:a5:ac", "network": {"id": "2ec75f7a-7e84-4ace-9f26-d0b3d758b93c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-548583994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bebae52273848ebaa7ef0260df630d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e22afce-83", "ovs_interfaceid": "2e22afce-83a2-4c64-98ea-95591cc04ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG os_vif [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e22afce-83, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:13 user nova-compute[72780]: INFO os_vif [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:a5:ac,bridge_name='br-int',has_traffic_filtering=True,id=2e22afce-83a2-4c64-98ea-95591cc04ad0,network=Network(2ec75f7a-7e84-4ace-9f26-d0b3d758b93c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e22afce-83')
Aug 09 01:11:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Deleting instance files /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca_del
Aug 09 01:11:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Deletion of /opt/stack/data/nova/instances/006a70f2-b9aa-47eb-b885-8f9e68926cca_del complete
Aug 09 01:11:13 user nova-compute[72780]: INFO nova.compute.manager [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 01:11:13 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:11:13 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:11:14 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543459.383377, 82b3d395-7aec-4312-8bdd-50a84e8f3830 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:14 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] VM Stopped (Lifecycle Event)
Aug 09 01:11:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a1d9e9a7-7f7a-4792-80f8-823ea479c2e4 None None] [instance: 82b3d395-7aec-4312-8bdd-50a84e8f3830] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:14 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-2e11928b-3728-4c70-955a-f8dbd769a230 req-5b945e12-e070-4e89-8148-ac9bf2ed1b26 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-vif-deleted-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:14 user nova-compute[72780]: INFO nova.compute.manager [req-2e11928b-3728-4c70-955a-f8dbd769a230 req-5b945e12-e070-4e89-8148-ac9bf2ed1b26 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Neutron deleted interface 2e22afce-83a2-4c64-98ea-95591cc04ad0; detaching it from the instance and deleting it from the info cache
Aug 09 01:11:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-2e11928b-3728-4c70-955a-f8dbd769a230 req-5b945e12-e070-4e89-8148-ac9bf2ed1b26 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:15 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Took 1.30 seconds to deallocate network for instance.
Aug 09 01:11:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-2e11928b-3728-4c70-955a-f8dbd769a230 req-5b945e12-e070-4e89-8148-ac9bf2ed1b26 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Detach interface failed, port_id=2e22afce-83a2-4c64-98ea-95591cc04ad0, reason: Instance 006a70f2-b9aa-47eb-b885-8f9e68926cca could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-bb6c00cb-bcd4-4ad3-801a-f8c965e059b7 req-c45f3df6-f3db-4e6c-a1fc-3922202cb815 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received event network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bb6c00cb-bcd4-4ad3-801a-f8c965e059b7 req-c45f3df6-f3db-4e6c-a1fc-3922202cb815 service nova] Acquiring lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bb6c00cb-bcd4-4ad3-801a-f8c965e059b7 req-c45f3df6-f3db-4e6c-a1fc-3922202cb815 service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bb6c00cb-bcd4-4ad3-801a-f8c965e059b7 req-c45f3df6-f3db-4e6c-a1fc-3922202cb815 service nova] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG nova.compute.manager [req-bb6c00cb-bcd4-4ad3-801a-f8c965e059b7 req-c45f3df6-f3db-4e6c-a1fc-3922202cb815 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] No waiting events found dispatching network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:15 user nova-compute[72780]: WARNING nova.compute.manager [req-bb6c00cb-bcd4-4ad3-801a-f8c965e059b7 req-c45f3df6-f3db-4e6c-a1fc-3922202cb815 service nova] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Received unexpected event network-vif-plugged-2e22afce-83a2-4c64-98ea-95591cc04ad0 for instance with vm_state deleted and task_state None.
Aug 09 01:11:15 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:15 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Deleted allocations for instance 006a70f2-b9aa-47eb-b885-8f9e68926cca
Aug 09 01:11:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ec2a7d58-1ce7-4e1b-b1aa-cacfa422821c tempest-TestServerVolumeAttachmentScenario-1362148067 tempest-TestServerVolumeAttachmentScenario-1362148067-project-member] Lock "006a70f2-b9aa-47eb-b885-8f9e68926cca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.531s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:18 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543463.89123, 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:18 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] VM Stopped (Lifecycle Event)
Aug 09 01:11:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-f95a91c0-beb4-437d-82b4-7bd59e191b41 None None] [instance: 81f5333f-3c4f-4eb7-a1f5-65fd712ee84d] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-c0e48653-1dc8-4ad8-aacf-52d169523400 req-216e15dc-5877-4306-bac1-420bd064ba13 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event volume-reimaged-be5328c3-a649-47d0-9365-284accb9ec38 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c0e48653-1dc8-4ad8-aacf-52d169523400 req-216e15dc-5877-4306-bac1-420bd064ba13 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c0e48653-1dc8-4ad8-aacf-52d169523400 req-216e15dc-5877-4306-bac1-420bd064ba13 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c0e48653-1dc8-4ad8-aacf-52d169523400 req-216e15dc-5877-4306-bac1-420bd064ba13 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-c0e48653-1dc8-4ad8-aacf-52d169523400 req-216e15dc-5877-4306-bac1-420bd064ba13 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Processing event volume-reimaged-be5328c3-a649-47d0-9365-284accb9ec38 {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:11:21 user nova-compute[72780]: INFO nova.virt.block_device [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Booting with volume be5328c3-a649-47d0-9365-284accb9ec38 at /dev/vda
Aug 09 01:11:21 user nova-compute[72780]: DEBUG os_brick.utils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ccab8a-0b09-4ddd-8b93-1fbe22ad3900]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[724bd775-fdfd-4b5d-8e95-b48055f0ecd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f643a-ab7b-4ecb-b61e-0c3fc9e68516]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[080fa198-b26b-4f1e-a354-e0c1f5c45c31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:11:21 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:11:21 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c9864-bba9-4539-bc28-2879d10abb2b]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG os_brick.utils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:11:21 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating existing volume attachment record: 4a5bf6d6-5ae2-4bac-9da3-a45bdc3c9e3f {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:11:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:24 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543469.9286113, dcd7e878-0475-4004-8a45-c15f405e0883 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:24 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] VM Stopped (Lifecycle Event)
Aug 09 01:11:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-527c5397-c42b-4cf0-98d5-d6059797718c None None] [instance: dcd7e878-0475-4004-8a45-c15f405e0883] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updating instance_info_cache with network_info: [{"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:11:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:11:27 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:27 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:28 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543473.8681402, 006a70f2-b9aa-47eb-b885-8f9e68926cca => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:28 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] VM Stopped (Lifecycle Event)
Aug 09 01:11:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-e6b01fb4-efb9-4240-ac5d-6558ce5c1293 None None] [instance: 006a70f2-b9aa-47eb-b885-8f9e68926cca] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:11:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Creating image(s)
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Ensure instance console log exists: /opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Start _get_guest_xml network_info=[{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b8a7c86-1bdf-4cf9-8064-a2505c9b2366', 'attached_at': '', 'detached_at': '', 'volume_id': 'be5328c3-a649-47d0-9365-284accb9ec38', 'serial': 'be5328c3-a649-47d0-9365-284accb9ec38'}, 'disk_bus': 'virtio', 'attachment_id': '4a5bf6d6-5ae2-4bac-9da3-a45bdc3c9e3f', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:11:29 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 01:11:29 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:11:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:11:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:11:29 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff5d3d9-9445-41e7-9f48-9cacb21ed295]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:11:29 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0abde13-ccfc-4fa4-b3e3-fd2844015db1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38] added
Aug 09 01:11:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8627a19-af72-4ce3-b9d0-35caa68d22cf]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc58d68-5856-4430-957a-129aad4ffe3a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adkvBpDU {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adkvBpDU" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[088d91aa-9d99-4591-af28-d1bd97fef936]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'adkvBpDU'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b37001-0ead-4e32-89b3-ee52e5e74e1e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbda904b-dba0-4de4-b582-952cb28ec7dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:11:29 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:11:29 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:11:29 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:11:29 user nova-compute[72780]: : NotImplementedError
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36816a68-668a-4b97-ab07-6e2e513eb031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]
Aug 09 01:11:29 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.
Aug 09 01:11:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f183f7-2e6f-4477-99c8-8a6a4b69c20a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa05d6d-62e9-4562-84cd-00ec5869d65d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:11:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:11:29 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5049f33d-d119-4c36-87f7-e16d61501ae5]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:11:29 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23361326237353362', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361326237353362', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-701238868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1890691155',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwqtgwy2TT9KcvouviRj8PUBjCw3OhwSi4n7Zob4lglKVdHHrd8lvhPzfTAAe1qzH1pBuNK9oqDnfgUziMnK5qU/yF13yQEfIt+GZ3tI19B/wS3/2cK3+8/yFESYALC4w==',key_name='tempest-keypair-385507197',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='040b6f9693f942fe9cf0fbce3d015e29',ramdisk_id='',reservation_id='r-i3ic35y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2020741728',owner_user_name='tempest-ServerActionsV293TestJSON-2020741728-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a94bf4a8aa224f5e8568d1bd4be408f5',uuid=5b8a7c86-1bdf-4cf9-8064-a2505c9b2366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converting VIF {"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:11:30 user nova-compute[72780]:   <uuid>5b8a7c86-1bdf-4cf9-8064-a2505c9b2366</uuid>
Aug 09 01:11:30 user nova-compute[72780]:   <name>instance-00000025</name>
Aug 09 01:11:30 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:11:30 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:11:30 user nova-compute[72780]:   <metadata>
Aug 09 01:11:30 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:11:30 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:11:30 user nova-compute[72780]:       <nova:name>tempest-ServerActionsV293TestJSON-server-701238868</nova:name>
Aug 09 01:11:30 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:11:29</nova:creationTime>
Aug 09 01:11:30 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:11:30 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:11:30 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:11:30 user nova-compute[72780]:       <nova:owner>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:user uuid="a94bf4a8aa224f5e8568d1bd4be408f5">tempest-ServerActionsV293TestJSON-2020741728-project-member</nova:user>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:project uuid="040b6f9693f942fe9cf0fbce3d015e29">tempest-ServerActionsV293TestJSON-2020741728</nova:project>
Aug 09 01:11:30 user nova-compute[72780]:       </nova:owner>
Aug 09 01:11:30 user nova-compute[72780]:       <nova:ports>
Aug 09 01:11:30 user nova-compute[72780]:         <nova:port uuid="e4236ae9-35df-4fb2-92e2-8908dc00cdd9">
Aug 09 01:11:30 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 01:11:30 user nova-compute[72780]:         </nova:port>
Aug 09 01:11:30 user nova-compute[72780]:       </nova:ports>
Aug 09 01:11:30 user nova-compute[72780]:     </nova:instance>
Aug 09 01:11:30 user nova-compute[72780]:   </metadata>
Aug 09 01:11:30 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:11:30 user nova-compute[72780]:     <system>
Aug 09 01:11:30 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:11:30 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:11:30 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:11:30 user nova-compute[72780]:       <entry name="serial">5b8a7c86-1bdf-4cf9-8064-a2505c9b2366</entry>
Aug 09 01:11:30 user nova-compute[72780]:       <entry name="uuid">5b8a7c86-1bdf-4cf9-8064-a2505c9b2366</entry>
Aug 09 01:11:30 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:11:30 user nova-compute[72780]:     </system>
Aug 09 01:11:30 user nova-compute[72780]:   </sysinfo>
Aug 09 01:11:30 user nova-compute[72780]:   <os>
Aug 09 01:11:30 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:11:30 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:11:30 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:11:30 user nova-compute[72780]:   </os>
Aug 09 01:11:30 user nova-compute[72780]:   <features>
Aug 09 01:11:30 user nova-compute[72780]:     <acpi/>
Aug 09 01:11:30 user nova-compute[72780]:     <apic/>
Aug 09 01:11:30 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:11:30 user nova-compute[72780]:   </features>
Aug 09 01:11:30 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:11:30 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:11:30 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:11:30 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:11:30 user nova-compute[72780]:   </clock>
Aug 09 01:11:30 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:11:30 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:11:30 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:11:30 user nova-compute[72780]:   </cpu>
Aug 09 01:11:30 user nova-compute[72780]:   <devices>
Aug 09 01:11:30 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:11:30 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:11:30 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 01:11:30 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:11:30 user nova-compute[72780]:       <serial>be5328c3-a649-47d0-9365-284accb9ec38</serial>
Aug 09 01:11:30 user nova-compute[72780]:     </disk>
Aug 09 01:11:30 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:11:30 user nova-compute[72780]:       <mac address="fa:16:3e:16:cc:ae"/>
Aug 09 01:11:30 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:11:30 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:11:30 user nova-compute[72780]:       <target dev="tape4236ae9-35"/>
Aug 09 01:11:30 user nova-compute[72780]:     </interface>
Aug 09 01:11:30 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:11:30 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366/console.log" append="off"/>
Aug 09 01:11:30 user nova-compute[72780]:     </serial>
Aug 09 01:11:30 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:11:30 user nova-compute[72780]:     <video>
Aug 09 01:11:30 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:11:30 user nova-compute[72780]:     </video>
Aug 09 01:11:30 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:11:30 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:11:30 user nova-compute[72780]:     </rng>
Aug 09 01:11:30 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:11:30 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:11:30 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:11:30 user nova-compute[72780]:     </memballoon>
Aug 09 01:11:30 user nova-compute[72780]:   </devices>
Aug 09 01:11:30 user nova-compute[72780]: </domain>
Aug 09 01:11:30 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-701238868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1890691155',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwqtgwy2TT9KcvouviRj8PUBjCw3OhwSi4n7Zob4lglKVdHHrd8lvhPzfTAAe1qzH1pBuNK9oqDnfgUziMnK5qU/yF13yQEfIt+GZ3tI19B/wS3/2cK3+8/yFESYALC4w==',key_name='tempest-keypair-385507197',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='040b6f9693f942fe9cf0fbce3d015e29',ramdisk_id='',reservation_id='r-i3ic35y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2020741728',owner_user_name='tempest-ServerActionsV293TestJSON-2020741728-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a94bf4a8aa224f5e8568d1bd4be408f5',uuid=5b8a7c86-1bdf-4cf9-8064-a2505c9b2366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converting VIF {"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG os_vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4236ae9-35, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4236ae9-35, col_values=(('external_ids', {'iface-id': 'e4236ae9-35df-4fb2-92e2-8908dc00cdd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:cc:ae', 'vm-uuid': '5b8a7c86-1bdf-4cf9-8064-a2505c9b2366'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:30 user nova-compute[72780]: INFO os_vif [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35')
Aug 09 01:11:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:11:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=25.19619369506836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] No VIF found with MAC fa:16:3e:16:cc:ae, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61c9d542-625d-4683-8b61-291c47d1fa91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:11:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-3c3fc10a-545f-416c-8496-455b5bcac527 req-8bbb0063-cbef-439b-841b-a66c2d732628 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3c3fc10a-545f-416c-8496-455b5bcac527 req-8bbb0063-cbef-439b-841b-a66c2d732628 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3c3fc10a-545f-416c-8496-455b5bcac527 req-8bbb0063-cbef-439b-841b-a66c2d732628 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3c3fc10a-545f-416c-8496-455b5bcac527 req-8bbb0063-cbef-439b-841b-a66c2d732628 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-3c3fc10a-545f-416c-8496-455b5bcac527 req-8bbb0063-cbef-439b-841b-a66c2d732628 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:32 user nova-compute[72780]: WARNING nova.compute.manager [req-3c3fc10a-545f-416c-8496-455b5bcac527 req-8bbb0063-cbef-439b-841b-a66c2d732628 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543494.4001822, 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] VM Resumed (Lifecycle Event)
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:11:34 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance spawned successfully.
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:11:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543494.4041562, 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:11:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] VM Started (Lifecycle Event)
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:11:34 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72780) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c0e48653-1dc8-4ad8-aacf-52d169523400 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [req-55b66220-6832-4b1d-bce4-7e78457cec15 req-5e032b17-418f-44c1-a76a-43f084345137 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-55b66220-6832-4b1d-bce4-7e78457cec15 req-5e032b17-418f-44c1-a76a-43f084345137 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-55b66220-6832-4b1d-bce4-7e78457cec15 req-5e032b17-418f-44c1-a76a-43f084345137 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-55b66220-6832-4b1d-bce4-7e78457cec15 req-5e032b17-418f-44c1-a76a-43f084345137 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:34 user nova-compute[72780]: DEBUG nova.compute.manager [req-55b66220-6832-4b1d-bce4-7e78457cec15 req-5e032b17-418f-44c1-a76a-43f084345137 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:34 user nova-compute[72780]: WARNING nova.compute.manager [req-55b66220-6832-4b1d-bce4-7e78457cec15 req-5e032b17-418f-44c1-a76a-43f084345137 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state None.
Aug 09 01:11:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:11:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:51 user nova-compute[72780]: INFO nova.compute.manager [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Terminating instance
Aug 09 01:11:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Instance destroyed successfully.
Aug 09 01:11:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lazy-loading 'resources' on Instance uuid 61c9d542-625d-4683-8b61-291c47d1fa91 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1567257275',display_name='tempest-ServerStableDeviceRescueTest-server-1567257275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1567257275',id=31,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUzekflLmlc5LAkJ2IatdZQbNepkB4OsrCtPb1gR4RsNKgy6wIJTXSry7i+VdTW71w4+uZPP/x/hxiC1Ey1ZzrEmANlETYF6Stigj5NUnyU05i/BmaJEeeB2dwZ355dA==',key_name='tempest-keypair-904094662',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f635836b7a148b7a1e12c818e5edaeb',ramdisk_id='',reservation_id='r-bwz2a2uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-506067792',owner_user_name='tempest-ServerStableDeviceRescueTest-506067792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d5adbbde00b43678092c96e19826a51',uuid=61c9d542-625d-4683-8b61-291c47d1fa91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converting VIF {"id": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "address": "fa:16:3e:d8:b6:0b", "network": {"id": "4c72cc75-e357-4377-9b33-6f73dea81316", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-447042848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f635836b7a148b7a1e12c818e5edaeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c0ac4-c7", "ovs_interfaceid": "d51c0ac4-c7b3-4865-a20f-838a2a837956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG os_vif [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd51c0ac4-c7, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:11:52 user nova-compute[72780]: INFO os_vif [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:b6:0b,bridge_name='br-int',has_traffic_filtering=True,id=d51c0ac4-c7b3-4865-a20f-838a2a837956,network=Network(4c72cc75-e357-4377-9b33-6f73dea81316),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c0ac4-c7')
Aug 09 01:11:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Deleting instance files /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91_del
Aug 09 01:11:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Deletion of /opt/stack/data/nova/instances/61c9d542-625d-4683-8b61-291c47d1fa91_del complete
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-2677057a-1628-468e-9c0a-3f5a76a27cc3 req-70606772-2057-4b43-9045-97b44df6ec11 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2677057a-1628-468e-9c0a-3f5a76a27cc3 req-70606772-2057-4b43-9045-97b44df6ec11 service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2677057a-1628-468e-9c0a-3f5a76a27cc3 req-70606772-2057-4b43-9045-97b44df6ec11 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2677057a-1628-468e-9c0a-3f5a76a27cc3 req-70606772-2057-4b43-9045-97b44df6ec11 service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-2677057a-1628-468e-9c0a-3f5a76a27cc3 req-70606772-2057-4b43-9045-97b44df6ec11 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-2677057a-1628-468e-9c0a-3f5a76a27cc3 req-70606772-2057-4b43-9045-97b44df6ec11 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-unplugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:11:52 user nova-compute[72780]: INFO nova.compute.manager [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 09 01:11:52 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:11:52 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6a4c541-7e04-4e71-ae97-2f5a20031fd0 req-23ad82bb-d661-4eb7-bf0c-434dfe095d72 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-deleted-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:53 user nova-compute[72780]: INFO nova.compute.manager [req-a6a4c541-7e04-4e71-ae97-2f5a20031fd0 req-23ad82bb-d661-4eb7-bf0c-434dfe095d72 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Neutron deleted interface d51c0ac4-c7b3-4865-a20f-838a2a837956; detaching it from the instance and deleting it from the info cache
Aug 09 01:11:53 user nova-compute[72780]: DEBUG nova.network.neutron [req-a6a4c541-7e04-4e71-ae97-2f5a20031fd0 req-23ad82bb-d661-4eb7-bf0c-434dfe095d72 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:11:53 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Took 1.32 seconds to deallocate network for instance.
Aug 09 01:11:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-a6a4c541-7e04-4e71-ae97-2f5a20031fd0 req-23ad82bb-d661-4eb7-bf0c-434dfe095d72 service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Detach interface failed, port_id=d51c0ac4-c7b3-4865-a20f-838a2a837956, reason: Instance 61c9d542-625d-4683-8b61-291c47d1fa91 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:11:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:53 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Deleted allocations for instance 61c9d542-625d-4683-8b61-291c47d1fa91
Aug 09 01:11:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-afc186c4-d702-4a11-b1dd-e649edaae143 tempest-ServerStableDeviceRescueTest-506067792 tempest-ServerStableDeviceRescueTest-506067792-project-member] Lock "61c9d542-625d-4683-8b61-291c47d1fa91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c0c6af8-825d-42ce-a8bf-78c661e86fc7 req-419beb0e-ba3d-4e89-b5b4-8848d68b279a service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:11:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c0c6af8-825d-42ce-a8bf-78c661e86fc7 req-419beb0e-ba3d-4e89-b5b4-8848d68b279a service nova] Acquiring lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:11:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c0c6af8-825d-42ce-a8bf-78c661e86fc7 req-419beb0e-ba3d-4e89-b5b4-8848d68b279a service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:11:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2c0c6af8-825d-42ce-a8bf-78c661e86fc7 req-419beb0e-ba3d-4e89-b5b4-8848d68b279a service nova] Lock "61c9d542-625d-4683-8b61-291c47d1fa91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:11:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-2c0c6af8-825d-42ce-a8bf-78c661e86fc7 req-419beb0e-ba3d-4e89-b5b4-8848d68b279a service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] No waiting events found dispatching network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:11:54 user nova-compute[72780]: WARNING nova.compute.manager [req-2c0c6af8-825d-42ce-a8bf-78c661e86fc7 req-419beb0e-ba3d-4e89-b5b4-8848d68b279a service nova] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Received unexpected event network-vif-plugged-d51c0ac4-c7b3-4865-a20f-838a2a837956 for instance with vm_state deleted and task_state None.
Aug 09 01:11:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:11:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:12:01 user nova-compute[72780]: INFO nova.compute.claims [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Claim successful on node user
Aug 09 01:12:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.network.neutron [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:12:02 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:12:02 user nova-compute[72780]: INFO nova.virt.block_device [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Booting with volume db25c212-bd25-4e1c-b4e7-c3a6b855035c at /dev/vda
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.policy [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54101aceab04126ba338c9965790cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9933f68af5d6419e92195eb3b49687a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG os_brick.utils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbe1683-a342-4106-a2b7-b7ce8a481416]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd51601-3151-42ff-8e31-5a91b61ca780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c054315-9234-45f0-a47d-712f9f639e9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b67509-ff7f-4feb-aa46-389e2068ef35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:12:02 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:12:02 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a83bd-8a41-4a55-b7d4-4a09274387ff]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG os_brick.utils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:12:02 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating existing volume attachment record: 304e672a-863f-4da0-8551-9d17c8904f48 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:12:03 user nova-compute[72780]: DEBUG nova.network.neutron [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Successfully created port: a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Successfully updated port: a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquired lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-changed-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG nova.compute.manager [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Refreshing instance network info cache due to event network-changed-a3198fe3-3ec4-4140-b0d7-7584ba3dde69. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] Acquiring lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:04 user nova-compute[72780]: DEBUG nova.network.neutron [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating instance_info_cache with network_info: [{"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Releasing lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Instance network_info: |[{"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] Acquired lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Refreshing network info cache for port a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updated VIF entry in instance network info cache for port a3198fe3-3ec4-4140-b0d7-7584ba3dde69. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG nova.network.neutron [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating instance_info_cache with network_info: [{"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-e8dfcf4e-1f13-4444-b3a3-dfc3b8d69fcd req-8d6fa956-5511-44ed-8820-8593d975dca3 service nova] Releasing lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:12:06 user nova-compute[72780]: INFO nova.compute.claims [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Claim successful on node user
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:12:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543511.9375882, 61c9d542-625d-4683-8b61-291c47d1fa91 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:06 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] VM Stopped (Lifecycle Event)
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-db382478-1434-4e0c-be10-22e5db37cd3d None None] [instance: 61c9d542-625d-4683-8b61-291c47d1fa91] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.policy [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59257e56086046b0a27ce3880c309586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9784ac1238a41e598ec36907111c770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:12:07 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Creating image(s)
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:12:07 user nova-compute[72780]: INFO nova.compute.claims [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Claim successful on node user
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.164s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk 1073741824" returned: 0 in 0.054s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Successfully created port: 875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Cannot resize image /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'migration_context' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:12:07 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:12:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.policy [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59257e56086046b0a27ce3880c309586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9784ac1238a41e598ec36907111c770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:12:08 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Creating image(s)
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk 1073741824" returned: 0 in 0.088s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Successfully updated port: 875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-changed-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Refreshing instance network info cache due to event network-changed-875e2936-190d-4d22-83bb-45e92e3737ea. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Cannot resize image /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'migration_context' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Ensure instance console log exists: /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Successfully created port: 604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance network_info: |[{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Refreshing network info cache for port 875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Start _get_guest_xml network_info=[{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:12:09 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:09 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181529430',display_name='tempest-ServerRescueNegativeTestJSON-server-1181529430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181529430',id=39,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-2xb7aij0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:07Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=f2b9c8e3-3ca7-452d-a586-11130fa4442a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:12:09 user nova-compute[72780]:   <uuid>f2b9c8e3-3ca7-452d-a586-11130fa4442a</uuid>
Aug 09 01:12:09 user nova-compute[72780]:   <name>instance-00000027</name>
Aug 09 01:12:09 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:12:09 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:12:09 user nova-compute[72780]:   <metadata>
Aug 09 01:12:09 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:12:09 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:12:09 user nova-compute[72780]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1181529430</nova:name>
Aug 09 01:12:09 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:12:09</nova:creationTime>
Aug 09 01:12:09 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:12:09 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:12:09 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:12:09 user nova-compute[72780]:       <nova:owner>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:user uuid="59257e56086046b0a27ce3880c309586">tempest-ServerRescueNegativeTestJSON-1588572554-project-member</nova:user>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:project uuid="b9784ac1238a41e598ec36907111c770">tempest-ServerRescueNegativeTestJSON-1588572554</nova:project>
Aug 09 01:12:09 user nova-compute[72780]:       </nova:owner>
Aug 09 01:12:09 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:12:09 user nova-compute[72780]:       <nova:ports>
Aug 09 01:12:09 user nova-compute[72780]:         <nova:port uuid="875e2936-190d-4d22-83bb-45e92e3737ea">
Aug 09 01:12:09 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 01:12:09 user nova-compute[72780]:         </nova:port>
Aug 09 01:12:09 user nova-compute[72780]:       </nova:ports>
Aug 09 01:12:09 user nova-compute[72780]:     </nova:instance>
Aug 09 01:12:09 user nova-compute[72780]:   </metadata>
Aug 09 01:12:09 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:12:09 user nova-compute[72780]:     <system>
Aug 09 01:12:09 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:12:09 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:12:09 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:12:09 user nova-compute[72780]:       <entry name="serial">f2b9c8e3-3ca7-452d-a586-11130fa4442a</entry>
Aug 09 01:12:09 user nova-compute[72780]:       <entry name="uuid">f2b9c8e3-3ca7-452d-a586-11130fa4442a</entry>
Aug 09 01:12:09 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:12:09 user nova-compute[72780]:     </system>
Aug 09 01:12:09 user nova-compute[72780]:   </sysinfo>
Aug 09 01:12:09 user nova-compute[72780]:   <os>
Aug 09 01:12:09 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:12:09 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:12:09 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:12:09 user nova-compute[72780]:   </os>
Aug 09 01:12:09 user nova-compute[72780]:   <features>
Aug 09 01:12:09 user nova-compute[72780]:     <acpi/>
Aug 09 01:12:09 user nova-compute[72780]:     <apic/>
Aug 09 01:12:09 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:12:09 user nova-compute[72780]:   </features>
Aug 09 01:12:09 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:12:09 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:12:09 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:12:09 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:12:09 user nova-compute[72780]:   </clock>
Aug 09 01:12:09 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:12:09 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:12:09 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:12:09 user nova-compute[72780]:   </cpu>
Aug 09 01:12:09 user nova-compute[72780]:   <devices>
Aug 09 01:12:09 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:12:09 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:12:09 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk"/>
Aug 09 01:12:09 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:12:09 user nova-compute[72780]:     </disk>
Aug 09 01:12:09 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:12:09 user nova-compute[72780]:       <mac address="fa:16:3e:8c:50:36"/>
Aug 09 01:12:09 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:12:09 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:12:09 user nova-compute[72780]:       <target dev="tap875e2936-19"/>
Aug 09 01:12:09 user nova-compute[72780]:     </interface>
Aug 09 01:12:09 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:12:09 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/console.log" append="off"/>
Aug 09 01:12:09 user nova-compute[72780]:     </serial>
Aug 09 01:12:09 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:12:09 user nova-compute[72780]:     <video>
Aug 09 01:12:09 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:12:09 user nova-compute[72780]:     </video>
Aug 09 01:12:09 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:12:09 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:12:09 user nova-compute[72780]:     </rng>
Aug 09 01:12:09 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:12:09 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:12:09 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:12:09 user nova-compute[72780]:     </memballoon>
Aug 09 01:12:09 user nova-compute[72780]:   </devices>
Aug 09 01:12:09 user nova-compute[72780]: </domain>
Aug 09 01:12:09 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181529430',display_name='tempest-ServerRescueNegativeTestJSON-server-1181529430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181529430',id=39,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-2xb7aij0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:07Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=f2b9c8e3-3ca7-452d-a586-11130fa4442a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG os_vif [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875e2936-19, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap875e2936-19, col_values=(('external_ids', {'iface-id': '875e2936-190d-4d22-83bb-45e92e3737ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:50:36', 'vm-uuid': 'f2b9c8e3-3ca7-452d-a586-11130fa4442a'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:09 user nova-compute[72780]: INFO os_vif [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19')
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:8c:50:36, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updated VIF entry in instance network info cache for port 875e2936-190d-4d22-83bb-45e92e3737ea. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-53a92d00-be03-4cb7-aa8f-2a9887c3fee7 req-14fe523f-7b96-4595-a598-1bd4a8535387 service nova] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Successfully updated port: 604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:09 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-changed-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Refreshing instance network info cache due to event network-changed-604d0086-a5dd-4ffb-ac97-6c2d398bfbff. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance network_info: |[{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Refreshing network info cache for port 604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Start _get_guest_xml network_info=[{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:12:10 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:10 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-314315361',display_name='tempest-ServerRescueNegativeTestJSON-server-314315361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-314315361',id=40,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ifpvm170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:08Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=be87d2a1-c64a-414f-87f9-17e54b7ce18f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'pci_devices' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:12:10 user nova-compute[72780]:   <uuid>be87d2a1-c64a-414f-87f9-17e54b7ce18f</uuid>
Aug 09 01:12:10 user nova-compute[72780]:   <name>instance-00000028</name>
Aug 09 01:12:10 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:12:10 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:12:10 user nova-compute[72780]:   <metadata>
Aug 09 01:12:10 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:12:10 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:12:10 user nova-compute[72780]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-314315361</nova:name>
Aug 09 01:12:10 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:12:10</nova:creationTime>
Aug 09 01:12:10 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:12:10 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:12:10 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:12:10 user nova-compute[72780]:       <nova:owner>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:user uuid="59257e56086046b0a27ce3880c309586">tempest-ServerRescueNegativeTestJSON-1588572554-project-member</nova:user>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:project uuid="b9784ac1238a41e598ec36907111c770">tempest-ServerRescueNegativeTestJSON-1588572554</nova:project>
Aug 09 01:12:10 user nova-compute[72780]:       </nova:owner>
Aug 09 01:12:10 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:12:10 user nova-compute[72780]:       <nova:ports>
Aug 09 01:12:10 user nova-compute[72780]:         <nova:port uuid="604d0086-a5dd-4ffb-ac97-6c2d398bfbff">
Aug 09 01:12:10 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 01:12:10 user nova-compute[72780]:         </nova:port>
Aug 09 01:12:10 user nova-compute[72780]:       </nova:ports>
Aug 09 01:12:10 user nova-compute[72780]:     </nova:instance>
Aug 09 01:12:10 user nova-compute[72780]:   </metadata>
Aug 09 01:12:10 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:12:10 user nova-compute[72780]:     <system>
Aug 09 01:12:10 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:12:10 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:12:10 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:12:10 user nova-compute[72780]:       <entry name="serial">be87d2a1-c64a-414f-87f9-17e54b7ce18f</entry>
Aug 09 01:12:10 user nova-compute[72780]:       <entry name="uuid">be87d2a1-c64a-414f-87f9-17e54b7ce18f</entry>
Aug 09 01:12:10 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:12:10 user nova-compute[72780]:     </system>
Aug 09 01:12:10 user nova-compute[72780]:   </sysinfo>
Aug 09 01:12:10 user nova-compute[72780]:   <os>
Aug 09 01:12:10 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:12:10 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:12:10 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:12:10 user nova-compute[72780]:   </os>
Aug 09 01:12:10 user nova-compute[72780]:   <features>
Aug 09 01:12:10 user nova-compute[72780]:     <acpi/>
Aug 09 01:12:10 user nova-compute[72780]:     <apic/>
Aug 09 01:12:10 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:12:10 user nova-compute[72780]:   </features>
Aug 09 01:12:10 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:12:10 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:12:10 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:12:10 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:12:10 user nova-compute[72780]:   </clock>
Aug 09 01:12:10 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:12:10 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:12:10 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:12:10 user nova-compute[72780]:   </cpu>
Aug 09 01:12:10 user nova-compute[72780]:   <devices>
Aug 09 01:12:10 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:12:10 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:12:10 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk"/>
Aug 09 01:12:10 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:12:10 user nova-compute[72780]:     </disk>
Aug 09 01:12:10 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:12:10 user nova-compute[72780]:       <mac address="fa:16:3e:ed:96:29"/>
Aug 09 01:12:10 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:12:10 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:12:10 user nova-compute[72780]:       <target dev="tap604d0086-a5"/>
Aug 09 01:12:10 user nova-compute[72780]:     </interface>
Aug 09 01:12:10 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:12:10 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/console.log" append="off"/>
Aug 09 01:12:10 user nova-compute[72780]:     </serial>
Aug 09 01:12:10 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:12:10 user nova-compute[72780]:     <video>
Aug 09 01:12:10 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:12:10 user nova-compute[72780]:     </video>
Aug 09 01:12:10 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:12:10 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:12:10 user nova-compute[72780]:     </rng>
Aug 09 01:12:10 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:12:10 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:12:10 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:12:10 user nova-compute[72780]:     </memballoon>
Aug 09 01:12:10 user nova-compute[72780]:   </devices>
Aug 09 01:12:10 user nova-compute[72780]: </domain>
Aug 09 01:12:10 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-314315361',display_name='tempest-ServerRescueNegativeTestJSON-server-314315361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-314315361',id=40,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ifpvm170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:08Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=be87d2a1-c64a-414f-87f9-17e54b7ce18f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG os_vif [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap604d0086-a5, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap604d0086-a5, col_values=(('external_ids', {'iface-id': '604d0086-a5dd-4ffb-ac97-6c2d398bfbff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:96:29', 'vm-uuid': 'be87d2a1-c64a-414f-87f9-17e54b7ce18f'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:10 user nova-compute[72780]: INFO os_vif [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5')
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:ed:96:29, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updated VIF entry in instance network info cache for port 604d0086-a5dd-4ffb-ac97-6c2d398bfbff. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a066e89f-efb4-4167-80d8-7fd7ae576064 req-429bab54-7558-4678-bb54-d018335496b6 service nova] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:12 user nova-compute[72780]: WARNING nova.compute.manager [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state building and task_state spawning.
Aug 09 01:12:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:12 user nova-compute[72780]: WARNING nova.compute.manager [req-d6d870b2-cdeb-473b-9f30-f9b320e73fb8 req-290e5d93-4e74-42cd-9b25-574022de32e4 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state building and task_state spawning.
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-773391b4-ba4c-40c3-8cbb-d9097f6e704b req-e2f20f6a-5970-48e6-9a41-91209b43a42f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-773391b4-ba4c-40c3-8cbb-d9097f6e704b req-e2f20f6a-5970-48e6-9a41-91209b43a42f service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-773391b4-ba4c-40c3-8cbb-d9097f6e704b req-e2f20f6a-5970-48e6-9a41-91209b43a42f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-773391b4-ba4c-40c3-8cbb-d9097f6e704b req-e2f20f6a-5970-48e6-9a41-91209b43a42f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-773391b4-ba4c-40c3-8cbb-d9097f6e704b req-e2f20f6a-5970-48e6-9a41-91209b43a42f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:12 user nova-compute[72780]: WARNING nova.compute.manager [req-773391b4-ba4c-40c3-8cbb-d9097f6e704b req-e2f20f6a-5970-48e6-9a41-91209b43a42f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state building and task_state spawning.
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543534.730926, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Resumed (Lifecycle Event)
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance spawned successfully.
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543534.7324047, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Started (Lifecycle Event)
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-d279de72-f58a-4f35-8fc5-dac087fc1dc2 req-a30f0fdb-6880-4a20-a87a-38d8f863918a service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d279de72-f58a-4f35-8fc5-dac087fc1dc2 req-a30f0fdb-6880-4a20-a87a-38d8f863918a service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d279de72-f58a-4f35-8fc5-dac087fc1dc2 req-a30f0fdb-6880-4a20-a87a-38d8f863918a service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d279de72-f58a-4f35-8fc5-dac087fc1dc2 req-a30f0fdb-6880-4a20-a87a-38d8f863918a service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-d279de72-f58a-4f35-8fc5-dac087fc1dc2 req-a30f0fdb-6880-4a20-a87a-38d8f863918a service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:14 user nova-compute[72780]: WARNING nova.compute.manager [req-d279de72-f58a-4f35-8fc5-dac087fc1dc2 req-a30f0fdb-6880-4a20-a87a-38d8f863918a service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state building and task_state spawning.
Aug 09 01:12:14 user nova-compute[72780]: INFO nova.compute.manager [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Took 8.52 seconds to build instance.
Aug 09 01:12:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0d5e2853-d2d5-4882-b7c8-b8f614d43aa5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.635s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543535.0378842, be87d2a1-c64a-414f-87f9-17e54b7ce18f => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] VM Resumed (Lifecycle Event)
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance spawned successfully.
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543535.0380301, be87d2a1-c64a-414f-87f9-17e54b7ce18f => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] VM Started (Lifecycle Event)
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 09 01:12:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:12:15 user nova-compute[72780]: INFO nova.compute.manager [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Took 8.10 seconds to build instance.
Aug 09 01:12:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d8271c5a-5b60-4653-92b2-19c2ab2596ec tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.243s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:12:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Creating image(s)
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Ensure instance console log exists: /opt/stack/data/nova/instances/78d2bcaa-cce4-4468-8b6a-343cb8456a83/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Start _get_guest_xml network_info=[{"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78d2bcaa-cce4-4468-8b6a-343cb8456a83', 'attached_at': '', 'detached_at': '', 'volume_id': 'db25c212-bd25-4e1c-b4e7-c3a6b855035c', 'serial': 'db25c212-bd25-4e1c-b4e7-c3a6b855035c'}, 'disk_bus': 'virtio', 'attachment_id': '304e672a-863f-4da0-8551-9d17c8904f48', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:12:19 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:19 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:12:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:12:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:12:19 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c23dbb4-60cf-4a31-8175-b9d223c4706f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:12:19 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2755fa-90ea-4f9f-8136-55029143ed41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c] added
Aug 09 01:12:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec034d-135a-46a4-b201-f41af70ca18a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbfc560-052e-40d0-a318-70d65fe33f84]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etdWkaDT {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etdWkaDT" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fc1c58-e501-442b-94c3-a29f1f4c826b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etdWkaDT'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[13084bed-ecb7-4273-9717-08b706bc54cd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a70696c-0fdc-4eba-bb6b-a657461fc7f3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:12:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:12:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d39865f-3e3b-441b-a74c-65fd44ab1e32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]
Aug 09 01:12:19 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.
Aug 09 01:12:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04a8eca-485f-4b3c-aa3f-61a8b1e36835]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb8b274-59e2-40bc-bb5b-95fcd5b3ec42]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:12:19 user nova-compute[72780]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:12:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:12:19 user nova-compute[72780]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:12:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d0883-e05a-49b9-8dfc-c1b663f9644a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:12:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23261323739323436', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261323739323436', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1168247212',display_name='tempest-TestVolumeBootPattern-server-1168247212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1168247212',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-00whjpaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:02Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=78d2bcaa-cce4-4468-8b6a-343cb8456a83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'pci_devices' on Instance uuid 78d2bcaa-cce4-4468-8b6a-343cb8456a83 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:12:20 user nova-compute[72780]:   <uuid>78d2bcaa-cce4-4468-8b6a-343cb8456a83</uuid>
Aug 09 01:12:20 user nova-compute[72780]:   <name>instance-00000026</name>
Aug 09 01:12:20 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:12:20 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:12:20 user nova-compute[72780]:   <metadata>
Aug 09 01:12:20 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:12:20 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:12:20 user nova-compute[72780]:       <nova:name>tempest-TestVolumeBootPattern-server-1168247212</nova:name>
Aug 09 01:12:20 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:12:19</nova:creationTime>
Aug 09 01:12:20 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:12:20 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:12:20 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:12:20 user nova-compute[72780]:       <nova:owner>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:user uuid="d54101aceab04126ba338c9965790cf3">tempest-TestVolumeBootPattern-1708118170-project-member</nova:user>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:project uuid="9933f68af5d6419e92195eb3b49687a8">tempest-TestVolumeBootPattern-1708118170</nova:project>
Aug 09 01:12:20 user nova-compute[72780]:       </nova:owner>
Aug 09 01:12:20 user nova-compute[72780]:       <nova:ports>
Aug 09 01:12:20 user nova-compute[72780]:         <nova:port uuid="a3198fe3-3ec4-4140-b0d7-7584ba3dde69">
Aug 09 01:12:20 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 01:12:20 user nova-compute[72780]:         </nova:port>
Aug 09 01:12:20 user nova-compute[72780]:       </nova:ports>
Aug 09 01:12:20 user nova-compute[72780]:     </nova:instance>
Aug 09 01:12:20 user nova-compute[72780]:   </metadata>
Aug 09 01:12:20 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:12:20 user nova-compute[72780]:     <system>
Aug 09 01:12:20 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:12:20 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:12:20 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:12:20 user nova-compute[72780]:       <entry name="serial">78d2bcaa-cce4-4468-8b6a-343cb8456a83</entry>
Aug 09 01:12:20 user nova-compute[72780]:       <entry name="uuid">78d2bcaa-cce4-4468-8b6a-343cb8456a83</entry>
Aug 09 01:12:20 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:12:20 user nova-compute[72780]:     </system>
Aug 09 01:12:20 user nova-compute[72780]:   </sysinfo>
Aug 09 01:12:20 user nova-compute[72780]:   <os>
Aug 09 01:12:20 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:12:20 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:12:20 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:12:20 user nova-compute[72780]:   </os>
Aug 09 01:12:20 user nova-compute[72780]:   <features>
Aug 09 01:12:20 user nova-compute[72780]:     <acpi/>
Aug 09 01:12:20 user nova-compute[72780]:     <apic/>
Aug 09 01:12:20 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:12:20 user nova-compute[72780]:   </features>
Aug 09 01:12:20 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:12:20 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:12:20 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:12:20 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:12:20 user nova-compute[72780]:   </clock>
Aug 09 01:12:20 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:12:20 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:12:20 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:12:20 user nova-compute[72780]:   </cpu>
Aug 09 01:12:20 user nova-compute[72780]:   <devices>
Aug 09 01:12:20 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:12:20 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:12:20 user nova-compute[72780]:       <source dev="/dev/sdc"/>
Aug 09 01:12:20 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:12:20 user nova-compute[72780]:       <serial>db25c212-bd25-4e1c-b4e7-c3a6b855035c</serial>
Aug 09 01:12:20 user nova-compute[72780]:     </disk>
Aug 09 01:12:20 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:12:20 user nova-compute[72780]:       <mac address="fa:16:3e:8d:3d:e6"/>
Aug 09 01:12:20 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:12:20 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:12:20 user nova-compute[72780]:       <target dev="tapa3198fe3-3e"/>
Aug 09 01:12:20 user nova-compute[72780]:     </interface>
Aug 09 01:12:20 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:12:20 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/78d2bcaa-cce4-4468-8b6a-343cb8456a83/console.log" append="off"/>
Aug 09 01:12:20 user nova-compute[72780]:     </serial>
Aug 09 01:12:20 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:12:20 user nova-compute[72780]:     <video>
Aug 09 01:12:20 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:12:20 user nova-compute[72780]:     </video>
Aug 09 01:12:20 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:12:20 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:12:20 user nova-compute[72780]:     </rng>
Aug 09 01:12:20 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:12:20 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:12:20 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:12:20 user nova-compute[72780]:     </memballoon>
Aug 09 01:12:20 user nova-compute[72780]:   </devices>
Aug 09 01:12:20 user nova-compute[72780]: </domain>
Aug 09 01:12:20 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1168247212',display_name='tempest-TestVolumeBootPattern-server-1168247212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1168247212',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-00whjpaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:02Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=78d2bcaa-cce4-4468-8b6a-343cb8456a83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG os_vif [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3198fe3-3e, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3198fe3-3e, col_values=(('external_ids', {'iface-id': 'a3198fe3-3ec4-4140-b0d7-7584ba3dde69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:3d:e6', 'vm-uuid': '78d2bcaa-cce4-4468-8b6a-343cb8456a83'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:20 user nova-compute[72780]: INFO os_vif [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e')
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:12:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No VIF found with MAC fa:16:3e:8d:3d:e6, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:12:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-8b2e9812-b15f-4ed3-8cad-0d1633f9005b req-622c7285-d6b8-44c7-98f7-4be7c5b1b397 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8b2e9812-b15f-4ed3-8cad-0d1633f9005b req-622c7285-d6b8-44c7-98f7-4be7c5b1b397 service nova] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8b2e9812-b15f-4ed3-8cad-0d1633f9005b req-622c7285-d6b8-44c7-98f7-4be7c5b1b397 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8b2e9812-b15f-4ed3-8cad-0d1633f9005b req-622c7285-d6b8-44c7-98f7-4be7c5b1b397 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-8b2e9812-b15f-4ed3-8cad-0d1633f9005b req-622c7285-d6b8-44c7-98f7-4be7c5b1b397 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] No waiting events found dispatching network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:22 user nova-compute[72780]: WARNING nova.compute.manager [req-8b2e9812-b15f-4ed3-8cad-0d1633f9005b req-622c7285-d6b8-44c7-98f7-4be7c5b1b397 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received unexpected event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 for instance with vm_state building and task_state spawning.
Aug 09 01:12:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-0cda95a4-4765-4150-8026-d4a8d27d21ec req-8aee797b-3255-4340-8a44-b69581758cc2 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0cda95a4-4765-4150-8026-d4a8d27d21ec req-8aee797b-3255-4340-8a44-b69581758cc2 service nova] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0cda95a4-4765-4150-8026-d4a8d27d21ec req-8aee797b-3255-4340-8a44-b69581758cc2 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0cda95a4-4765-4150-8026-d4a8d27d21ec req-8aee797b-3255-4340-8a44-b69581758cc2 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-0cda95a4-4765-4150-8026-d4a8d27d21ec req-8aee797b-3255-4340-8a44-b69581758cc2 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] No waiting events found dispatching network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:24 user nova-compute[72780]: WARNING nova.compute.manager [req-0cda95a4-4765-4150-8026-d4a8d27d21ec req-8aee797b-3255-4340-8a44-b69581758cc2 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received unexpected event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 for instance with vm_state building and task_state spawning.
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543544.8442707, 78d2bcaa-cce4-4468-8b6a-343cb8456a83 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] VM Resumed (Lifecycle Event)
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Instance spawned successfully.
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:12:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543544.8444884, 78d2bcaa-cce4-4468-8b6a-343cb8456a83 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] VM Started (Lifecycle Event)
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:12:24 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:12:25 user nova-compute[72780]: INFO nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 09 01:12:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:25 user nova-compute[72780]: INFO nova.compute.manager [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Took 23.27 seconds to build instance.
Aug 09 01:12:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-96ab8caf-d750-4840-be71-d1dce546fce5 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.375s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating instance_info_cache with network_info: [{"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:12:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:12:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:30 user nova-compute[72780]: INFO nova.compute.manager [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Terminating instance
Aug 09 01:12:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7d1cbc4-073d-4e02-976a-1630aefd75ec req-bd78aad4-1e7d-474f-9f13-8a943438ecca service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-vif-unplugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7d1cbc4-073d-4e02-976a-1630aefd75ec req-bd78aad4-1e7d-474f-9f13-8a943438ecca service nova] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7d1cbc4-073d-4e02-976a-1630aefd75ec req-bd78aad4-1e7d-474f-9f13-8a943438ecca service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c7d1cbc4-073d-4e02-976a-1630aefd75ec req-bd78aad4-1e7d-474f-9f13-8a943438ecca service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7d1cbc4-073d-4e02-976a-1630aefd75ec req-bd78aad4-1e7d-474f-9f13-8a943438ecca service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] No waiting events found dispatching network-vif-unplugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-c7d1cbc4-073d-4e02-976a-1630aefd75ec req-bd78aad4-1e7d-474f-9f13-8a943438ecca service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-vif-unplugged-bc501bed-1290-4db9-832b-1c122d9d2db0 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Instance destroyed successfully.
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lazy-loading 'resources' on Instance uuid e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-267123619',display_name='tempest-ServersNegativeTestJSON-server-267123619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-267123619',id=29,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bdc20d829ea406fa62810d68d336ee9',ramdisk_id='',reservation_id='r-k6qlf7ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1030464829',owner_user_name='tempest-ServersNegativeTestJSON-1030464829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:03:42Z,user_data=None,user_id='3c08a00919854aaf9f20c0b66c54eb21',uuid=e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converting VIF {"id": "bc501bed-1290-4db9-832b-1c122d9d2db0", "address": "fa:16:3e:e5:22:d6", "network": {"id": "96f10672-e5d6-4663-8220-f198c09d1192", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2045649789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bdc20d829ea406fa62810d68d336ee9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc501bed-12", "ovs_interfaceid": "bc501bed-1290-4db9-832b-1c122d9d2db0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG os_vif [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc501bed-12, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:12:31 user nova-compute[72780]: INFO os_vif [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc501bed-1290-4db9-832b-1c122d9d2db0,network=Network(96f10672-e5d6-4663-8220-f198c09d1192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc501bed-12')
Aug 09 01:12:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Deleting instance files /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb_del
Aug 09 01:12:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Deletion of /opt/stack/data/nova/instances/e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb_del complete
Aug 09 01:12:31 user nova-compute[72780]: INFO nova.compute.manager [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:12:31 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid 'e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb' (instance-0000001d)
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:32 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Took 0.73 seconds to deallocate network for instance.
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:32 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:32 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:12:32 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8119MB free_disk=25.25421905517578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:12:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.230s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:33 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Deleted allocations for instance e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78d2bcaa-cce4-4468-8b6a-343cb8456a83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-83fa2bb4-a910-47b7-8b69-e74b2fe019c9 tempest-ServersNegativeTestJSON-1030464829 tempest-ServersNegativeTestJSON-1030464829-project-member] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.514s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] Acquiring lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] Lock "e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] No waiting events found dispatching network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:33 user nova-compute[72780]: WARNING nova.compute.manager [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received unexpected event network-vif-plugged-bc501bed-1290-4db9-832b-1c122d9d2db0 for instance with vm_state deleted and task_state None.
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-fec2be15-03de-4b0c-813f-4766480d9d36 req-8785c2f5-d6af-4f43-933d-239e05fc539c service nova] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Received event network-vif-deleted-bc501bed-1290-4db9-832b-1c122d9d2db0 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:12:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:12:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543551.6313934, e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:12:46 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] VM Stopped (Lifecycle Event)
Aug 09 01:12:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6c39b220-2231-4c25-8200-87286faca6cc None None] [instance: e55b52d9-01bb-4ff9-ad92-1ff4cff5f0cb] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:46 user nova-compute[72780]: INFO nova.compute.manager [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Terminating instance
Aug 09 01:12:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-9f2d74d5-0081-499e-960a-3ea77556d62b req-368e3364-f5ea-4322-b3a4-f159b8e6faa8 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9f2d74d5-0081-499e-960a-3ea77556d62b req-368e3364-f5ea-4322-b3a4-f159b8e6faa8 service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9f2d74d5-0081-499e-960a-3ea77556d62b req-368e3364-f5ea-4322-b3a4-f159b8e6faa8 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9f2d74d5-0081-499e-960a-3ea77556d62b req-368e3364-f5ea-4322-b3a4-f159b8e6faa8 service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-9f2d74d5-0081-499e-960a-3ea77556d62b req-368e3364-f5ea-4322-b3a4-f159b8e6faa8 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.compute.manager [req-9f2d74d5-0081-499e-960a-3ea77556d62b req-368e3364-f5ea-4322-b3a4-f159b8e6faa8 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Instance destroyed successfully.
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lazy-loading 'resources' on Instance uuid 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-701238868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1890691155',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwqtgwy2TT9KcvouviRj8PUBjCw3OhwSi4n7Zob4lglKVdHHrd8lvhPzfTAAe1qzH1pBuNK9oqDnfgUziMnK5qU/yF13yQEfIt+GZ3tI19B/wS3/2cK3+8/yFESYALC4w==',key_name='tempest-keypair-385507197',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='040b6f9693f942fe9cf0fbce3d015e29',ramdisk_id='',reservation_id='r-i3ic35y5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2020741728',owner_user_name='tempest-ServerActionsV293TestJSON-2020741728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a94bf4a8aa224f5e8568d1bd4be408f5',uuid=5b8a7c86-1bdf-4cf9-8064-a2505c9b2366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converting VIF {"id": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "address": "fa:16:3e:16:cc:ae", "network": {"id": "1000dda9-52d5-418d-aed6-043df362233d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2060933859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "040b6f9693f942fe9cf0fbce3d015e29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4236ae9-35", "ovs_interfaceid": "e4236ae9-35df-4fb2-92e2-8908dc00cdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_vif [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4236ae9-35, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: INFO os_vif [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:cc:ae,bridge_name='br-int',has_traffic_filtering=True,id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9,network=Network(1000dda9-52d5-418d-aed6-043df362233d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4236ae9-35')
Aug 09 01:12:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adkvBpDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:12:47 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a155701-45ec-48db-911e-624d727d8c2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3f1f27-bc60-45ed-9134-f38e52ed2ed9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:12:47 user nova-compute[72780]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:12:47 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 (non-flash)
Aug 09 01:12:47 user nova-compute[72780]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:12:47 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0179360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb382dca-a409-4616-a0b5-150b43ac603a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b65a3-91be-446d-ab86-25837e52ec96]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad09d070-4720-40d8-9378-34100a7b8614]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbe07b3-7ca9-4b52-b624-eef4e67307fe]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1550006-3a2b753bd09df6fc', '/dev/disk/by-id/scsi-23361326237353362', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1550006') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b562cad5-2aca-4058-93a6-e86b7ad88cc6]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:12:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc25be6-dc49-4b22-b612-e356701abb8e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91340f0-8fd6-442f-977a-1b70f47ee660]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260]
Aug 09 01:12:48 user nova-compute[72780]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38, portal: 172.16.0.220,3260] successful.
Aug 09 01:12:48 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5328c3-a649-47d0-9365-284accb9ec38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e7079-c53f-46bb-a66e-f82417b90992]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] <== disconnect_volume: return (336ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:12:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Deleting instance files /opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366_del
Aug 09 01:12:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Deletion of /opt/stack/data/nova/instances/5b8a7c86-1bdf-4cf9-8064-a2505c9b2366_del complete
Aug 09 01:12:48 user nova-compute[72780]: INFO nova.compute.manager [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 01:12:48 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:49 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Took 0.95 seconds to deallocate network for instance.
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-f7166584-a197-409b-9142-d62f026f3f0e req-4723346f-54fc-4489-84aa-b77214382a28 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-deleted-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:49 user nova-compute[72780]: INFO nova.compute.manager [req-f7166584-a197-409b-9142-d62f026f3f0e req-4723346f-54fc-4489-84aa-b77214382a28 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Neutron deleted interface e4236ae9-35df-4fb2-92e2-8908dc00cdd9; detaching it from the instance and deleting it from the info cache
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.network.neutron [req-f7166584-a197-409b-9142-d62f026f3f0e req-4723346f-54fc-4489-84aa-b77214382a28 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-f7166584-a197-409b-9142-d62f026f3f0e req-4723346f-54fc-4489-84aa-b77214382a28 service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Detach interface failed, port_id=e4236ae9-35df-4fb2-92e2-8908dc00cdd9, reason: Instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:49 user nova-compute[72780]: WARNING nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state deleting.
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:49 user nova-compute[72780]: WARNING nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state deleting.
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:49 user nova-compute[72780]: WARNING nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state deleting.
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-unplugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Acquiring lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] No waiting events found dispatching network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:12:49 user nova-compute[72780]: WARNING nova.compute.manager [req-d4a1f747-5bf2-41dc-a7b7-91416db292ba req-6695e81c-bf01-47f5-96cc-2190424c29af service nova] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Received unexpected event network-vif-plugged-e4236ae9-35df-4fb2-92e2-8908dc00cdd9 for instance with vm_state active and task_state deleting.
Aug 09 01:12:50 user nova-compute[72780]: INFO nova.compute.manager [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Took 0.95 seconds to detach 1 volumes for instance.
Aug 09 01:12:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Deleting volume: be5328c3-a649-47d0-9365-284accb9ec38 {{(pid=72780) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 01:12:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:12:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:12:50 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:12:50 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:12:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:50 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Deleted allocations for instance 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366
Aug 09 01:12:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-73d72f58-a56b-4afa-bc94-9915834a2958 tempest-ServerActionsV293TestJSON-2020741728 tempest-ServerActionsV293TestJSON-2020741728-project-member] Lock "5b8a7c86-1bdf-4cf9-8064-a2505c9b2366" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.622s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:12:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:12:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543567.7153685, 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:13:02 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] VM Stopped (Lifecycle Event)
Aug 09 01:13:02 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6a726946-7f34-452b-a734-af7c4a52fcc5 None None] [instance: 5b8a7c86-1bdf-4cf9-8064-a2505c9b2366] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:13:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:13:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 78d2bcaa-cce4-4468-8b6a-343cb8456a83 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating instance_info_cache with network_info: [{"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:13:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:13:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:13:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:13:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:33 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:13:34 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:13:34 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8375MB free_disk=25.26653289794922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 78d2bcaa-cce4-4468-8b6a-343cb8456a83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:13:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:13:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-changed-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:13:54 user nova-compute[72780]: DEBUG nova.compute.manager [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Refreshing instance network info cache due to event network-changed-a3198fe3-3ec4-4140-b0d7-7584ba3dde69. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:13:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] Acquiring lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:13:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] Acquired lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:13:54 user nova-compute[72780]: DEBUG nova.network.neutron [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Refreshing network info cache for port a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updated VIF entry in instance network info cache for port a3198fe3-3ec4-4140-b0d7-7584ba3dde69. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG nova.network.neutron [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating instance_info_cache with network_info: [{"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-caba9865-fbb3-4a15-913d-3da6bacb1b06 req-c8440fc8-148e-4a4e-ada0-ef3ea5a56b15 service nova] Releasing lock "refresh_cache-78d2bcaa-cce4-4468-8b6a-343cb8456a83" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:55 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:13:55 user nova-compute[72780]: INFO nova.compute.claims [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Claim successful on node user
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.network.neutron [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:13:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.policy [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7abd6cb25b47b58ccd80d9fda7ece0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd3451d1fb641ad8106f8b4bcb68fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:13:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Creating image(s)
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:56 user nova-compute[72780]: INFO nova.compute.manager [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Terminating instance
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.166s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk 1073741824" returned: 0 in 0.054s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:13:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Cannot resize image /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.objects.instance [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'migration_context' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Ensure instance console log exists: /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:57 user nova-compute[72780]: INFO nova.compute.manager [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Rescuing
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.network.neutron [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Instance destroyed successfully.
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'resources' on Instance uuid 78d2bcaa-cce4-4468-8b6a-343cb8456a83 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1168247212',display_name='tempest-TestVolumeBootPattern-server-1168247212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1168247212',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-00whjpaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:12:25Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=78d2bcaa-cce4-4468-8b6a-343cb8456a83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "address": "fa:16:3e:8d:3d:e6", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3198fe3-3e", "ovs_interfaceid": "a3198fe3-3ec4-4140-b0d7-7584ba3dde69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_vif [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3198fe3-3e, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:13:57 user nova-compute[72780]: INFO os_vif [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3d:e6,bridge_name='br-int',has_traffic_filtering=True,id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3198fe3-3e')
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:13:57 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[960d2fd4-bd1e-4c39-97c6-38f7b6347c56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-3e3891d0-c627-4cf1-80d4-221bca6c96d0 req-7529c6e4-ae53-405d-9cc9-e5cfa24a8625 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-unplugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3e3891d0-c627-4cf1-80d4-221bca6c96d0 req-7529c6e4-ae53-405d-9cc9-e5cfa24a8625 service nova] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3e3891d0-c627-4cf1-80d4-221bca6c96d0 req-7529c6e4-ae53-405d-9cc9-e5cfa24a8625 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3e3891d0-c627-4cf1-80d4-221bca6c96d0 req-7529c6e4-ae53-405d-9cc9-e5cfa24a8625 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-3e3891d0-c627-4cf1-80d4-221bca6c96d0 req-7529c6e4-ae53-405d-9cc9-e5cfa24a8625 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] No waiting events found dispatching network-vif-unplugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-3e3891d0-c627-4cf1-80d4-221bca6c96d0 req-7529c6e4-ae53-405d-9cc9-e5cfa24a8625 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-unplugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c635d37e-31bd-40b1-82d2-25189ae815a9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:13:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:13:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ad8319bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a95b7-fa72-4456-8653-3ff148485c40]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9865a7-9af7-4f9c-9836-6bf8c94060d3]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c2843d-5700-464e-b9d4-03fd49396ce0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b95453-d9c2-48b3-a9f7-38f8e7436d46]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9f5ab48b-2a279246f41904be', '/dev/disk/by-id/scsi-23261323739323436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9f5ab48b') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f730176-769b-4901-ae67-225144277253]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[906cac4a-20f1-405d-b4de-6b10f0cdbbba]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a592a1a-d8ff-40bd-a59e-dcc9d82dc13b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]
Aug 09 01:13:57 user nova-compute[72780]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.
Aug 09 01:13:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6bc12-9c73-4ca6-9de8-7e669a670f4f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== disconnect_volume: return (342ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:13:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Deleting instance files /opt/stack/data/nova/instances/78d2bcaa-cce4-4468-8b6a-343cb8456a83_del
Aug 09 01:13:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Deletion of /opt/stack/data/nova/instances/78d2bcaa-cce4-4468-8b6a-343cb8456a83_del complete
Aug 09 01:13:57 user nova-compute[72780]: INFO nova.compute.manager [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 09 01:13:57 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:13:57 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Successfully created port: ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:13:58 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-3914dd6f-fade-4d37-8d23-3a1ab9fd479a req-50e933ea-192d-409d-a251-7cbaf2be039f service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-deleted-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:13:59 user nova-compute[72780]: INFO nova.compute.manager [req-3914dd6f-fade-4d37-8d23-3a1ab9fd479a req-50e933ea-192d-409d-a251-7cbaf2be039f service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Neutron deleted interface a3198fe3-3ec4-4140-b0d7-7584ba3dde69; detaching it from the instance and deleting it from the info cache
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.network.neutron [req-3914dd6f-fade-4d37-8d23-3a1ab9fd479a req-50e933ea-192d-409d-a251-7cbaf2be039f service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:13:59 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Took 1.11 seconds to deallocate network for instance.
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-3914dd6f-fade-4d37-8d23-3a1ab9fd479a req-50e933ea-192d-409d-a251-7cbaf2be039f service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Detach interface failed, port_id=a3198fe3-3ec4-4140-b0d7-7584ba3dde69, reason: Instance 78d2bcaa-cce4-4468-8b6a-343cb8456a83 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:13:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance destroyed successfully.
Aug 09 01:13:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Attempting rescue
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72780) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 01:13:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Creating image(s)
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'trusted_certs' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.225s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue" returned: 0 in 0.058s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'migration_context' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Start _get_guest_xml network_info=[{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:ed:96:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'resources' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'numa_topology' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:59 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:13:59 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'vcpu_model' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-314315361',display_name='tempest-ServerRescueNegativeTestJSON-server-314315361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-314315361',id=40,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:12:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ifpvm170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:15Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=be87d2a1-c64a-414f-87f9-17e54b7ce18f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:ed:96:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:ed:96:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'pci_devices' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] No waiting events found dispatching network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:13:59 user nova-compute[72780]: WARNING nova.compute.manager [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received unexpected event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 for instance with vm_state active and task_state deleting.
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] Acquiring lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] No waiting events found dispatching network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:13:59 user nova-compute[72780]: WARNING nova.compute.manager [req-b7365130-6522-48f1-bf6a-f9bd3efe000c req-ff88fe27-4b55-4534-8d77-00b10a906902 service nova] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Received unexpected event network-vif-plugged-a3198fe3-3ec4-4140-b0d7-7584ba3dde69 for instance with vm_state active and task_state deleting.
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:13:59 user nova-compute[72780]:   <uuid>be87d2a1-c64a-414f-87f9-17e54b7ce18f</uuid>
Aug 09 01:13:59 user nova-compute[72780]:   <name>instance-00000028</name>
Aug 09 01:13:59 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:13:59 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:13:59 user nova-compute[72780]:   <metadata>
Aug 09 01:13:59 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:13:59 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:13:59 user nova-compute[72780]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-314315361</nova:name>
Aug 09 01:13:59 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:13:59</nova:creationTime>
Aug 09 01:13:59 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:13:59 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:13:59 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:13:59 user nova-compute[72780]:       <nova:owner>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:user uuid="59257e56086046b0a27ce3880c309586">tempest-ServerRescueNegativeTestJSON-1588572554-project-member</nova:user>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:project uuid="b9784ac1238a41e598ec36907111c770">tempest-ServerRescueNegativeTestJSON-1588572554</nova:project>
Aug 09 01:13:59 user nova-compute[72780]:       </nova:owner>
Aug 09 01:13:59 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:13:59 user nova-compute[72780]:       <nova:ports>
Aug 09 01:13:59 user nova-compute[72780]:         <nova:port uuid="604d0086-a5dd-4ffb-ac97-6c2d398bfbff">
Aug 09 01:13:59 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 01:13:59 user nova-compute[72780]:         </nova:port>
Aug 09 01:13:59 user nova-compute[72780]:       </nova:ports>
Aug 09 01:13:59 user nova-compute[72780]:     </nova:instance>
Aug 09 01:13:59 user nova-compute[72780]:   </metadata>
Aug 09 01:13:59 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:13:59 user nova-compute[72780]:     <system>
Aug 09 01:13:59 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:13:59 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:13:59 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:13:59 user nova-compute[72780]:       <entry name="serial">be87d2a1-c64a-414f-87f9-17e54b7ce18f</entry>
Aug 09 01:13:59 user nova-compute[72780]:       <entry name="uuid">be87d2a1-c64a-414f-87f9-17e54b7ce18f</entry>
Aug 09 01:13:59 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:13:59 user nova-compute[72780]:     </system>
Aug 09 01:13:59 user nova-compute[72780]:   </sysinfo>
Aug 09 01:13:59 user nova-compute[72780]:   <os>
Aug 09 01:13:59 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:13:59 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:13:59 user nova-compute[72780]:   </os>
Aug 09 01:13:59 user nova-compute[72780]:   <features>
Aug 09 01:13:59 user nova-compute[72780]:     <acpi/>
Aug 09 01:13:59 user nova-compute[72780]:     <apic/>
Aug 09 01:13:59 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:13:59 user nova-compute[72780]:   </features>
Aug 09 01:13:59 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:13:59 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:13:59 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:13:59 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:13:59 user nova-compute[72780]:   </clock>
Aug 09 01:13:59 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:13:59 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:13:59 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:13:59 user nova-compute[72780]:   </cpu>
Aug 09 01:13:59 user nova-compute[72780]:   <devices>
Aug 09 01:13:59 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:13:59 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:13:59 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue"/>
Aug 09 01:13:59 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:13:59 user nova-compute[72780]:     </disk>
Aug 09 01:13:59 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:13:59 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:13:59 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk"/>
Aug 09 01:13:59 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:13:59 user nova-compute[72780]:     </disk>
Aug 09 01:13:59 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:13:59 user nova-compute[72780]:       <mac address="fa:16:3e:ed:96:29"/>
Aug 09 01:13:59 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:13:59 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:13:59 user nova-compute[72780]:       <target dev="tap604d0086-a5"/>
Aug 09 01:13:59 user nova-compute[72780]:     </interface>
Aug 09 01:13:59 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:13:59 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/console.log" append="off"/>
Aug 09 01:13:59 user nova-compute[72780]:     </serial>
Aug 09 01:13:59 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:13:59 user nova-compute[72780]:     <video>
Aug 09 01:13:59 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:13:59 user nova-compute[72780]:     </video>
Aug 09 01:13:59 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:13:59 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:13:59 user nova-compute[72780]:     </rng>
Aug 09 01:13:59 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:13:59 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:13:59 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:13:59 user nova-compute[72780]:     </memballoon>
Aug 09 01:13:59 user nova-compute[72780]:   </devices>
Aug 09 01:13:59 user nova-compute[72780]: </domain>
Aug 09 01:13:59 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:13:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance destroyed successfully.
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:ed:96:29, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-06d631bd-b992-4610-887f-f47eddb8009e req-5b4c460d-810d-4b32-aea4-57877610a03e service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-unplugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-06d631bd-b992-4610-887f-f47eddb8009e req-5b4c460d-810d-4b32-aea4-57877610a03e service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-06d631bd-b992-4610-887f-f47eddb8009e req-5b4c460d-810d-4b32-aea4-57877610a03e service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-06d631bd-b992-4610-887f-f47eddb8009e req-5b4c460d-810d-4b32-aea4-57877610a03e service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:13:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-06d631bd-b992-4610-887f-f47eddb8009e req-5b4c460d-810d-4b32-aea4-57877610a03e service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-unplugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:13:59 user nova-compute[72780]: WARNING nova.compute.manager [req-06d631bd-b992-4610-887f-f47eddb8009e req-5b4c460d-810d-4b32-aea4-57877610a03e service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-unplugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state active and task_state rescuing.
Aug 09 01:14:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Successfully updated port: ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:14:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:14:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.network.neutron [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance network_info: |[{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Start _get_guest_xml network_info=[{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:14:01 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:01 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1775000355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1775000355',id=41,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhdtKTqLQZKty0d85BDuWqyX9TWWWgMYX73RdNXVOB5FK/I7CzhNiw+r6v+m5GaQ+dnt8PjtUliKD8KeDUrncDeJyH0qY9raQaf5G1hYaEXK7JHhMojREzYsxn6kaGgJg==',key_name='tempest-keypair-1784194185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-0nabra6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=841d4941-6521-453f-82ed-784ea088187f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'pci_devices' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:14:01 user nova-compute[72780]:   <uuid>841d4941-6521-453f-82ed-784ea088187f</uuid>
Aug 09 01:14:01 user nova-compute[72780]:   <name>instance-00000029</name>
Aug 09 01:14:01 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:14:01 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:14:01 user nova-compute[72780]:   <metadata>
Aug 09 01:14:01 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:14:01 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:14:01 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1775000355</nova:name>
Aug 09 01:14:01 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:14:01</nova:creationTime>
Aug 09 01:14:01 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:14:01 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:14:01 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:14:01 user nova-compute[72780]:       <nova:owner>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:user uuid="0c7abd6cb25b47b58ccd80d9fda7ece0">tempest-AttachVolumeShelveTestJSON-1412186531-project-member</nova:user>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:project uuid="9dd3451d1fb641ad8106f8b4bcb68fc1">tempest-AttachVolumeShelveTestJSON-1412186531</nova:project>
Aug 09 01:14:01 user nova-compute[72780]:       </nova:owner>
Aug 09 01:14:01 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:14:01 user nova-compute[72780]:       <nova:ports>
Aug 09 01:14:01 user nova-compute[72780]:         <nova:port uuid="ee7b8575-9982-4075-a6f7-103f8f626ff3">
Aug 09 01:14:01 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 01:14:01 user nova-compute[72780]:         </nova:port>
Aug 09 01:14:01 user nova-compute[72780]:       </nova:ports>
Aug 09 01:14:01 user nova-compute[72780]:     </nova:instance>
Aug 09 01:14:01 user nova-compute[72780]:   </metadata>
Aug 09 01:14:01 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:14:01 user nova-compute[72780]:     <system>
Aug 09 01:14:01 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:14:01 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:14:01 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:14:01 user nova-compute[72780]:       <entry name="serial">841d4941-6521-453f-82ed-784ea088187f</entry>
Aug 09 01:14:01 user nova-compute[72780]:       <entry name="uuid">841d4941-6521-453f-82ed-784ea088187f</entry>
Aug 09 01:14:01 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:14:01 user nova-compute[72780]:     </system>
Aug 09 01:14:01 user nova-compute[72780]:   </sysinfo>
Aug 09 01:14:01 user nova-compute[72780]:   <os>
Aug 09 01:14:01 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:14:01 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:14:01 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:14:01 user nova-compute[72780]:   </os>
Aug 09 01:14:01 user nova-compute[72780]:   <features>
Aug 09 01:14:01 user nova-compute[72780]:     <acpi/>
Aug 09 01:14:01 user nova-compute[72780]:     <apic/>
Aug 09 01:14:01 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:14:01 user nova-compute[72780]:   </features>
Aug 09 01:14:01 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:14:01 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:14:01 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:14:01 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:14:01 user nova-compute[72780]:   </clock>
Aug 09 01:14:01 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:14:01 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:14:01 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:14:01 user nova-compute[72780]:   </cpu>
Aug 09 01:14:01 user nova-compute[72780]:   <devices>
Aug 09 01:14:01 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:14:01 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:14:01 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk"/>
Aug 09 01:14:01 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:14:01 user nova-compute[72780]:     </disk>
Aug 09 01:14:01 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:14:01 user nova-compute[72780]:       <mac address="fa:16:3e:e3:be:76"/>
Aug 09 01:14:01 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:01 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:14:01 user nova-compute[72780]:       <target dev="tapee7b8575-99"/>
Aug 09 01:14:01 user nova-compute[72780]:     </interface>
Aug 09 01:14:01 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:14:01 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/console.log" append="off"/>
Aug 09 01:14:01 user nova-compute[72780]:     </serial>
Aug 09 01:14:01 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:14:01 user nova-compute[72780]:     <video>
Aug 09 01:14:01 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:01 user nova-compute[72780]:     </video>
Aug 09 01:14:01 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:14:01 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:14:01 user nova-compute[72780]:     </rng>
Aug 09 01:14:01 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:14:01 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:14:01 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:14:01 user nova-compute[72780]:     </memballoon>
Aug 09 01:14:01 user nova-compute[72780]:   </devices>
Aug 09 01:14:01 user nova-compute[72780]: </domain>
Aug 09 01:14:01 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1775000355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1775000355',id=41,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhdtKTqLQZKty0d85BDuWqyX9TWWWgMYX73RdNXVOB5FK/I7CzhNiw+r6v+m5GaQ+dnt8PjtUliKD8KeDUrncDeJyH0qY9raQaf5G1hYaEXK7JHhMojREzYsxn6kaGgJg==',key_name='tempest-keypair-1784194185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-0nabra6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=841d4941-6521-453f-82ed-784ea088187f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG os_vif [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee7b8575-99, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee7b8575-99, col_values=(('external_ids', {'iface-id': 'ee7b8575-9982-4075-a6f7-103f8f626ff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:be:76', 'vm-uuid': '841d4941-6521-453f-82ed-784ea088187f'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:14:01 user nova-compute[72780]: INFO os_vif [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99')
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No VIF found with MAC fa:16:3e:e3:be:76, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing instance network info cache due to event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:01 user nova-compute[72780]: WARNING nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state active and task_state rescuing.
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:01 user nova-compute[72780]: WARNING nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state active and task_state rescuing.
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:01 user nova-compute[72780]: WARNING nova.compute.manager [req-ca573993-f14e-44d5-995d-facbfa13d9d1 req-30b58b43-54a4-468b-bcaf-d4a6237ac35f service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state active and task_state rescuing.
Aug 09 01:14:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updated VIF entry in instance network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:14:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9e753f5f-6f63-4c3a-9893-5b5c7d26b188 req-7eddcd5e-e73d-474f-b25f-ee79e6e7c3a0 service nova] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:03 user nova-compute[72780]: INFO nova.compute.manager [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Took 4.67 seconds to detach 1 volumes for instance.
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:03 user nova-compute[72780]: WARNING nova.compute.manager [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state building and task_state spawning.
Aug 09 01:14:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:03 user nova-compute[72780]: WARNING nova.compute.manager [req-4fe2bbe2-80ec-4a3d-bad1-f043bf2f9e57 req-ec880ff7-96a2-4eab-b3e8-c30e9f7b079e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state building and task_state spawning.
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:04 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Deleted allocations for instance 78d2bcaa-cce4-4468-8b6a-343cb8456a83
Aug 09 01:14:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7f53eb6a-48d4-47cb-ba45-aa8c0d37af83 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "78d2bcaa-cce4-4468-8b6a-343cb8456a83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.668s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for be87d2a1-c64a-414f-87f9-17e54b7ce18f due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543644.6834507, be87d2a1-c64a-414f-87f9-17e54b7ce18f => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] VM Resumed (Lifecycle Event)
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-82fb100a-d0fd-4d1c-a39e-131b45f15030 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543644.6877816, be87d2a1-c64a-414f-87f9-17e54b7ce18f => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] VM Started (Lifecycle Event)
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 01:14:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543645.3455222, 841d4941-6521-453f-82ed-784ea088187f => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] VM Resumed (Lifecycle Event)
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance spawned successfully.
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543645.3491824, 841d4941-6521-453f-82ed-784ea088187f => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] VM Started (Lifecycle Event)
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Took 9.08 seconds to spawn the instance on the hypervisor.
Aug 09 01:14:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:14:05 user nova-compute[72780]: INFO nova.compute.manager [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Took 9.87 seconds to build instance.
Aug 09 01:14:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-86162b6c-45a4-4ea5-a841-5c05664aec39 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.988s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:12 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543637.4104714, 78d2bcaa-cce4-4468-8b6a-343cb8456a83 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:12 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] VM Stopped (Lifecycle Event)
Aug 09 01:14:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-7b203ba4-08f6-4908-925b-82e43e66fe7a None None] [instance: 78d2bcaa-cce4-4468-8b6a-343cb8456a83] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:16 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:14:16 user nova-compute[72780]: INFO nova.compute.claims [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Claim successful on node user
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:14:17 user nova-compute[72780]: INFO nova.compute.claims [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Claim successful on node user
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.network.neutron [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:14:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.policy [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9ec6e6c8ce14879a1397fec6429c4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16197c0497354e32b5ead73377548f30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:14:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Creating image(s)
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "/opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "/opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "/opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:14:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.policy [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b17e92fe6f4141a19ae4fa94c24eec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85055d2cc3d47fdb496d109879dcf2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk 1073741824" returned: 0 in 0.073s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:14:17 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Creating image(s)
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "52a889315edd41453fab6eb7db6c04f99069cb2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "52a889315edd41453fab6eb7db6c04f99069cb2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.190s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.network.neutron [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Successfully created port: ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Cannot resize image /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.objects.instance [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'migration_context' on Instance uuid d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Ensure instance console log exists: /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.virt.images [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] 762e0ae3-efa6-446e-900b-b85908e10dca was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.part /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:18 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Successfully created port: c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Successfully updated port: ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquired lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-changed-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Refreshing instance network info cache due to event network-changed-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] Acquiring lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.part /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.converted" returned: 0 in 0.507s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "52a889315edd41453fab6eb7db6c04f99069cb2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.382s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json" returned: 0 in 0.165s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "52a889315edd41453fab6eb7db6c04f99069cb2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "52a889315edd41453fab6eb7db6c04f99069cb2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updating instance_info_cache with network_info: [{"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Releasing lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Instance network_info: |[{"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] Acquired lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Refreshing network info cache for port ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Start _get_guest_xml network_info=[{"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:14:19 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:19 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2046210217',display_name='tempest-VolumesSnapshotTestJSON-instance-2046210217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2046210217',id=42,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgvt4LeKa9LfZwoA6QHOgOTlqR7p7L91+DpfXb9NtwqUC1BMxL96/ePzVIgeK20cDl7deQRs4BKKsXSQfb9ofvgk9lojXnI05kBkgLuZ6k05agH7si6EU1DHF/GNiOiA==',key_name='tempest-keypair-1507486502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16197c0497354e32b5ead73377548f30',ramdisk_id='',reservation_id='r-tlbg2x1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-468237489',owner_user_name='tempest-VolumesSnapshotTestJSON-468237489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ec6e6c8ce14879a1397fec6429c4d1',uuid=d278c2f7-4424-49f1-8750-c2f88d0096b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converting VIF {"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'pci_devices' on Instance uuid d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json" returned: 0 in 0.212s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e,backing_fmt=raw /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:14:19 user nova-compute[72780]:   <uuid>d278c2f7-4424-49f1-8750-c2f88d0096b8</uuid>
Aug 09 01:14:19 user nova-compute[72780]:   <name>instance-0000002a</name>
Aug 09 01:14:19 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:14:19 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:14:19 user nova-compute[72780]:   <metadata>
Aug 09 01:14:19 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:14:19 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:14:19 user nova-compute[72780]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2046210217</nova:name>
Aug 09 01:14:19 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:14:19</nova:creationTime>
Aug 09 01:14:19 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:14:19 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:14:19 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:14:19 user nova-compute[72780]:       <nova:owner>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:user uuid="f9ec6e6c8ce14879a1397fec6429c4d1">tempest-VolumesSnapshotTestJSON-468237489-project-member</nova:user>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:project uuid="16197c0497354e32b5ead73377548f30">tempest-VolumesSnapshotTestJSON-468237489</nova:project>
Aug 09 01:14:19 user nova-compute[72780]:       </nova:owner>
Aug 09 01:14:19 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:14:19 user nova-compute[72780]:       <nova:ports>
Aug 09 01:14:19 user nova-compute[72780]:         <nova:port uuid="ced8d4b1-fe80-4cef-92bd-253b1f5aafbf">
Aug 09 01:14:19 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 01:14:19 user nova-compute[72780]:         </nova:port>
Aug 09 01:14:19 user nova-compute[72780]:       </nova:ports>
Aug 09 01:14:19 user nova-compute[72780]:     </nova:instance>
Aug 09 01:14:19 user nova-compute[72780]:   </metadata>
Aug 09 01:14:19 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:14:19 user nova-compute[72780]:     <system>
Aug 09 01:14:19 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:14:19 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:14:19 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:14:19 user nova-compute[72780]:       <entry name="serial">d278c2f7-4424-49f1-8750-c2f88d0096b8</entry>
Aug 09 01:14:19 user nova-compute[72780]:       <entry name="uuid">d278c2f7-4424-49f1-8750-c2f88d0096b8</entry>
Aug 09 01:14:19 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:14:19 user nova-compute[72780]:     </system>
Aug 09 01:14:19 user nova-compute[72780]:   </sysinfo>
Aug 09 01:14:19 user nova-compute[72780]:   <os>
Aug 09 01:14:19 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:14:19 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:14:19 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:14:19 user nova-compute[72780]:   </os>
Aug 09 01:14:19 user nova-compute[72780]:   <features>
Aug 09 01:14:19 user nova-compute[72780]:     <acpi/>
Aug 09 01:14:19 user nova-compute[72780]:     <apic/>
Aug 09 01:14:19 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:14:19 user nova-compute[72780]:   </features>
Aug 09 01:14:19 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:14:19 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:14:19 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:14:19 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:14:19 user nova-compute[72780]:   </clock>
Aug 09 01:14:19 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:14:19 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:14:19 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:14:19 user nova-compute[72780]:   </cpu>
Aug 09 01:14:19 user nova-compute[72780]:   <devices>
Aug 09 01:14:19 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:14:19 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:14:19 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk"/>
Aug 09 01:14:19 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:14:19 user nova-compute[72780]:     </disk>
Aug 09 01:14:19 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:14:19 user nova-compute[72780]:       <mac address="fa:16:3e:ef:8c:cc"/>
Aug 09 01:14:19 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:19 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:14:19 user nova-compute[72780]:       <target dev="tapced8d4b1-fe"/>
Aug 09 01:14:19 user nova-compute[72780]:     </interface>
Aug 09 01:14:19 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:14:19 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/console.log" append="off"/>
Aug 09 01:14:19 user nova-compute[72780]:     </serial>
Aug 09 01:14:19 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:14:19 user nova-compute[72780]:     <video>
Aug 09 01:14:19 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:19 user nova-compute[72780]:     </video>
Aug 09 01:14:19 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:14:19 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:14:19 user nova-compute[72780]:     </rng>
Aug 09 01:14:19 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:14:19 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:14:19 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:14:19 user nova-compute[72780]:     </memballoon>
Aug 09 01:14:19 user nova-compute[72780]:   </devices>
Aug 09 01:14:19 user nova-compute[72780]: </domain>
Aug 09 01:14:19 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2046210217',display_name='tempest-VolumesSnapshotTestJSON-instance-2046210217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2046210217',id=42,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgvt4LeKa9LfZwoA6QHOgOTlqR7p7L91+DpfXb9NtwqUC1BMxL96/ePzVIgeK20cDl7deQRs4BKKsXSQfb9ofvgk9lojXnI05kBkgLuZ6k05agH7si6EU1DHF/GNiOiA==',key_name='tempest-keypair-1507486502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16197c0497354e32b5ead73377548f30',ramdisk_id='',reservation_id='r-tlbg2x1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-468237489',owner_user_name='tempest-VolumesSnapshotTestJSON-468237489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ec6e6c8ce14879a1397fec6429c4d1',uuid=d278c2f7-4424-49f1-8750-c2f88d0096b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converting VIF {"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG os_vif [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e,backing_fmt=raw /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk 1073741824" returned: 0 in 0.073s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "52a889315edd41453fab6eb7db6c04f99069cb2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Successfully updated port: c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced8d4b1-fe, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapced8d4b1-fe, col_values=(('external_ids', {'iface-id': 'ced8d4b1-fe80-4cef-92bd-253b1f5aafbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:8c:cc', 'vm-uuid': 'd278c2f7-4424-49f1-8750-c2f88d0096b8'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:19 user nova-compute[72780]: INFO os_vif [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe')
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing instance network info cache due to event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:19 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No VIF found with MAC fa:16:3e:ef:8c:cc, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Cannot resize image /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'migration_context' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Ensure instance console log exists: /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updated VIF entry in instance network info cache for port ced8d4b1-fe80-4cef-92bd-253b1f5aafbf. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updating instance_info_cache with network_info: [{"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-74373ca9-9708-4838-b7ee-3940a2aa9e07 req-207136d1-1a3a-4ba9-afee-4fccbf6f1ee8 service nova] Releasing lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance network_info: |[{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Start _get_guest_xml network_info=[{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T01:14:14Z,direct_url=<?>,disk_format='qcow2',id=762e0ae3-efa6-446e-900b-b85908e10dca,min_disk=0,min_ram=0,name='tempest-scenario-img--1883453434',owner='a85055d2cc3d47fdb496d109879dcf2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T01:14:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '762e0ae3-efa6-446e-900b-b85908e10dca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:14:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:20 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T01:14:14Z,direct_url=<?>,disk_format='qcow2',id=762e0ae3-efa6-446e-900b-b85908e10dca,min_disk=0,min_ram=0,name='tempest-scenario-img--1883453434',owner='a85055d2cc3d47fdb496d109879dcf2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T01:14:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1328901129',display_name='tempest-TestMinimumBasicScenario-server-1328901129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1328901129',id=43,image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTBb/f0tA7RQKiwVDK0Cqi8MzqeBz9KyvQg7X24229/5QBhHm4pVIDmfAxDXVl4OIu2jselLP0ZuXkiTiHKOjvUD+mTjCWHN/5Eq6e6/xD1rxlOc7fa74jFOX0jAQ11w==',key_name='tempest-TestMinimumBasicScenario-2041241445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-m07gdzw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:14:18Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=79a235e2-a374-4955-99bd-06a707295550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'pci_devices' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:14:20 user nova-compute[72780]:   <uuid>79a235e2-a374-4955-99bd-06a707295550</uuid>
Aug 09 01:14:20 user nova-compute[72780]:   <name>instance-0000002b</name>
Aug 09 01:14:20 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:14:20 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:14:20 user nova-compute[72780]:   <metadata>
Aug 09 01:14:20 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:14:20 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:14:20 user nova-compute[72780]:       <nova:name>tempest-TestMinimumBasicScenario-server-1328901129</nova:name>
Aug 09 01:14:20 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:14:20</nova:creationTime>
Aug 09 01:14:20 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:14:20 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:14:20 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:14:20 user nova-compute[72780]:       <nova:owner>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:user uuid="b17e92fe6f4141a19ae4fa94c24eec52">tempest-TestMinimumBasicScenario-546637949-project-member</nova:user>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:project uuid="a85055d2cc3d47fdb496d109879dcf2c">tempest-TestMinimumBasicScenario-546637949</nova:project>
Aug 09 01:14:20 user nova-compute[72780]:       </nova:owner>
Aug 09 01:14:20 user nova-compute[72780]:       <nova:root type="image" uuid="762e0ae3-efa6-446e-900b-b85908e10dca"/>
Aug 09 01:14:20 user nova-compute[72780]:       <nova:ports>
Aug 09 01:14:20 user nova-compute[72780]:         <nova:port uuid="c7e45dad-4206-4406-ab14-ad04ba3a283f">
Aug 09 01:14:20 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 01:14:20 user nova-compute[72780]:         </nova:port>
Aug 09 01:14:20 user nova-compute[72780]:       </nova:ports>
Aug 09 01:14:20 user nova-compute[72780]:     </nova:instance>
Aug 09 01:14:20 user nova-compute[72780]:   </metadata>
Aug 09 01:14:20 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:14:20 user nova-compute[72780]:     <system>
Aug 09 01:14:20 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:14:20 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:14:20 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:14:20 user nova-compute[72780]:       <entry name="serial">79a235e2-a374-4955-99bd-06a707295550</entry>
Aug 09 01:14:20 user nova-compute[72780]:       <entry name="uuid">79a235e2-a374-4955-99bd-06a707295550</entry>
Aug 09 01:14:20 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:14:20 user nova-compute[72780]:     </system>
Aug 09 01:14:20 user nova-compute[72780]:   </sysinfo>
Aug 09 01:14:20 user nova-compute[72780]:   <os>
Aug 09 01:14:20 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:14:20 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:14:20 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:14:20 user nova-compute[72780]:   </os>
Aug 09 01:14:20 user nova-compute[72780]:   <features>
Aug 09 01:14:20 user nova-compute[72780]:     <acpi/>
Aug 09 01:14:20 user nova-compute[72780]:     <apic/>
Aug 09 01:14:20 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:14:20 user nova-compute[72780]:   </features>
Aug 09 01:14:20 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:14:20 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:14:20 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:14:20 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:14:20 user nova-compute[72780]:   </clock>
Aug 09 01:14:20 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:14:20 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:14:20 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:14:20 user nova-compute[72780]:   </cpu>
Aug 09 01:14:20 user nova-compute[72780]:   <devices>
Aug 09 01:14:20 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:14:20 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:14:20 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk"/>
Aug 09 01:14:20 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:14:20 user nova-compute[72780]:     </disk>
Aug 09 01:14:20 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:14:20 user nova-compute[72780]:       <mac address="fa:16:3e:50:af:42"/>
Aug 09 01:14:20 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:20 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:14:20 user nova-compute[72780]:       <target dev="tapc7e45dad-42"/>
Aug 09 01:14:20 user nova-compute[72780]:     </interface>
Aug 09 01:14:20 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:14:20 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/console.log" append="off"/>
Aug 09 01:14:20 user nova-compute[72780]:     </serial>
Aug 09 01:14:20 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:14:20 user nova-compute[72780]:     <video>
Aug 09 01:14:20 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:20 user nova-compute[72780]:     </video>
Aug 09 01:14:20 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:14:20 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:14:20 user nova-compute[72780]:     </rng>
Aug 09 01:14:20 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:14:20 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:14:20 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:14:20 user nova-compute[72780]:     </memballoon>
Aug 09 01:14:20 user nova-compute[72780]:   </devices>
Aug 09 01:14:20 user nova-compute[72780]: </domain>
Aug 09 01:14:20 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1328901129',display_name='tempest-TestMinimumBasicScenario-server-1328901129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1328901129',id=43,image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTBb/f0tA7RQKiwVDK0Cqi8MzqeBz9KyvQg7X24229/5QBhHm4pVIDmfAxDXVl4OIu2jselLP0ZuXkiTiHKOjvUD+mTjCWHN/5Eq6e6/xD1rxlOc7fa74jFOX0jAQ11w==',key_name='tempest-TestMinimumBasicScenario-2041241445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-m07gdzw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:14:18Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=79a235e2-a374-4955-99bd-06a707295550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG os_vif [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7e45dad-42, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7e45dad-42, col_values=(('external_ids', {'iface-id': 'c7e45dad-4206-4406-ab14-ad04ba3a283f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:af:42', 'vm-uuid': '79a235e2-a374-4955-99bd-06a707295550'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:20 user nova-compute[72780]: INFO os_vif [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42')
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No VIF found with MAC fa:16:3e:50:af:42, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updated VIF entry in instance network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG nova.network.neutron [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-29471316-d6d8-4232-98ef-c6ae1ad5aec4 req-800c0667-ee6a-4890-95ed-a4f3fb79a03a service nova] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-7339bce2-51e6-46f3-ac6f-420fa3d903e4 req-c1d64fbb-8e4c-45f6-a7c5-3d48fb1515e6 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7339bce2-51e6-46f3-ac6f-420fa3d903e4 req-c1d64fbb-8e4c-45f6-a7c5-3d48fb1515e6 service nova] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7339bce2-51e6-46f3-ac6f-420fa3d903e4 req-c1d64fbb-8e4c-45f6-a7c5-3d48fb1515e6 service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7339bce2-51e6-46f3-ac6f-420fa3d903e4 req-c1d64fbb-8e4c-45f6-a7c5-3d48fb1515e6 service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-7339bce2-51e6-46f3-ac6f-420fa3d903e4 req-c1d64fbb-8e4c-45f6-a7c5-3d48fb1515e6 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] No waiting events found dispatching network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:22 user nova-compute[72780]: WARNING nova.compute.manager [req-7339bce2-51e6-46f3-ac6f-420fa3d903e4 req-c1d64fbb-8e4c-45f6-a7c5-3d48fb1515e6 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received unexpected event network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf for instance with vm_state building and task_state spawning.
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-c2bdc6db-d783-4b59-be35-0fa4a18fd58d req-83b1839c-30e6-4e3d-b6d7-b84e0c69a81f service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c2bdc6db-d783-4b59-be35-0fa4a18fd58d req-83b1839c-30e6-4e3d-b6d7-b84e0c69a81f service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c2bdc6db-d783-4b59-be35-0fa4a18fd58d req-83b1839c-30e6-4e3d-b6d7-b84e0c69a81f service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c2bdc6db-d783-4b59-be35-0fa4a18fd58d req-83b1839c-30e6-4e3d-b6d7-b84e0c69a81f service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-c2bdc6db-d783-4b59-be35-0fa4a18fd58d req-83b1839c-30e6-4e3d-b6d7-b84e0c69a81f service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:22 user nova-compute[72780]: WARNING nova.compute.manager [req-c2bdc6db-d783-4b59-be35-0fa4a18fd58d req-83b1839c-30e6-4e3d-b6d7-b84e0c69a81f service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state building and task_state spawning.
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-c1162368-baee-463c-a102-82226a650233 req-cc359d16-ed2e-4e0a-afc9-c3f8359fbf4d service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c1162368-baee-463c-a102-82226a650233 req-cc359d16-ed2e-4e0a-afc9-c3f8359fbf4d service nova] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c1162368-baee-463c-a102-82226a650233 req-cc359d16-ed2e-4e0a-afc9-c3f8359fbf4d service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c1162368-baee-463c-a102-82226a650233 req-cc359d16-ed2e-4e0a-afc9-c3f8359fbf4d service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-c1162368-baee-463c-a102-82226a650233 req-cc359d16-ed2e-4e0a-afc9-c3f8359fbf4d service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] No waiting events found dispatching network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:24 user nova-compute[72780]: WARNING nova.compute.manager [req-c1162368-baee-463c-a102-82226a650233 req-cc359d16-ed2e-4e0a-afc9-c3f8359fbf4d service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received unexpected event network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf for instance with vm_state building and task_state spawning.
Aug 09 01:14:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-3a677069-5f3d-44bb-88cd-f33d0685681e req-1ba1e0ee-74ef-426a-8cc1-d865a7d14295 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3a677069-5f3d-44bb-88cd-f33d0685681e req-1ba1e0ee-74ef-426a-8cc1-d865a7d14295 service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3a677069-5f3d-44bb-88cd-f33d0685681e req-1ba1e0ee-74ef-426a-8cc1-d865a7d14295 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3a677069-5f3d-44bb-88cd-f33d0685681e req-1ba1e0ee-74ef-426a-8cc1-d865a7d14295 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-3a677069-5f3d-44bb-88cd-f33d0685681e req-1ba1e0ee-74ef-426a-8cc1-d865a7d14295 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:14:24 user nova-compute[72780]: WARNING nova.compute.manager [req-3a677069-5f3d-44bb-88cd-f33d0685681e req-1ba1e0ee-74ef-426a-8cc1-d865a7d14295 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state building and task_state spawning.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543665.1582434, 79a235e2-a374-4955-99bd-06a707295550 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] VM Resumed (Lifecycle Event)
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance spawned successfully.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Instance spawned successfully.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543665.1600466, 79a235e2-a374-4955-99bd-06a707295550 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] VM Started (Lifecycle Event)
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543665.1621938, d278c2f7-4424-49f1-8750-c2f88d0096b8 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] VM Resumed (Lifecycle Event)
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Took 7.84 seconds to spawn the instance on the hypervisor.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Took 7.35 seconds to spawn the instance on the hypervisor.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543665.162258, d278c2f7-4424-49f1-8750-c2f88d0096b8 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] VM Started (Lifecycle Event)
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Took 8.64 seconds to build instance.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-677ce987-e838-4de0-b855-973e0a85b875 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.824s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:25 user nova-compute[72780]: INFO nova.compute.manager [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Took 8.30 seconds to build instance.
Aug 09 01:14:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ad7ab409-33bf-4cdf-9405-894ee4dd4bd6 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.402s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:14:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:32 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:34 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:35 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:36 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:36 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7891MB free_disk=25.160778045654297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 841d4941-6521-453f-82ed-784ea088187f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d278c2f7-4424-49f1-8750-c2f88d0096b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 79a235e2-a374-4955-99bd-06a707295550 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:14:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:14:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:14:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:48 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:14:48 user nova-compute[72780]: INFO nova.compute.claims [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Claim successful on node user
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:14:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:14:49 user nova-compute[72780]: INFO nova.virt.block_device [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Booting with volume db25c212-bd25-4e1c-b4e7-c3a6b855035c at /dev/vda
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.policy [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54101aceab04126ba338c9965790cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9933f68af5d6419e92195eb3b49687a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG os_brick.utils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca3d01-1867-49b0-8dea-63d2d32bc5d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b23b64-84fe-43fe-833e-7de75c0fd52e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b82b6ec-f87a-4e7c-838b-db990a901389]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced4278-4686-411d-b17e-79ae392f6f3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:14:49 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:14:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20d5086-15f7-4770-b0b5-5d4fdb9a30b4]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG os_brick.utils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:14:49 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating existing volume attachment record: d9240cb7-7684-4820-9c45-a803f5c56844 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Successfully created port: 6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Successfully updated port: 6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquired lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-changed-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Refreshing instance network info cache due to event network-changed-6df50ef7-e282-4d9c-aa2d-7a372a0c2022. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] Acquiring lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:14:50 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating instance_info_cache with network_info: [{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Releasing lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Instance network_info: |[{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] Acquired lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG nova.network.neutron [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Refreshing network info cache for port 6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG nova.network.neutron [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updated VIF entry in instance network info cache for port 6df50ef7-e282-4d9c-aa2d-7a372a0c2022. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG nova.network.neutron [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating instance_info_cache with network_info: [{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:14:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1314cc2a-0fc3-4535-89d6-3b2b59a24ebe req-87a39b44-af0c-48b3-982e-c6995d7d5125 service nova] Releasing lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:14:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:14:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Creating image(s)
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Ensure instance console log exists: /opt/stack/data/nova/instances/9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Start _get_guest_xml network_info=[{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'db25c212-bd25-4e1c-b4e7-c3a6b855035c', 'serial': 'db25c212-bd25-4e1c-b4e7-c3a6b855035c'}, 'disk_bus': 'virtio', 'attachment_id': 'd9240cb7-7684-4820-9c45-a803f5c56844', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:14:57 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:57 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:14:57 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:14:57 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:14:57 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b86a6e-8c72-40a9-be0e-19dda15cd07d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:14:57 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36deb976-0548-4f98-87a4-097eec20b03c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c] added
Aug 09 01:14:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ec874-adf3-49e2-aaee-405d308bb997]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56624aa9-1412-44a8-bdfe-c181daf8db9e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etdWkaDT {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etdWkaDT" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60e74f-a925-42e8-aef6-ab1e402f3da5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etdWkaDT'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.050s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb0cd13-88d5-4274-87e5-b854857e3a71]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d2e3a-ccc2-4d6a-9f82-8ce28f3251e1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:14:57 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:14:57 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:14:57 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:14:57 user nova-compute[72780]: 
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9399d9-fb34-4ec2-9108-7cc407c137be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]
Aug 09 01:14:57 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.
Aug 09 01:14:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.162s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9618153-d6d3-4d08-9418-6b08c327cbac]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5bde3e-8af1-4df9-8bc8-44a6ce445c7c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:14:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:14:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1028aa-04b1-42fa-ab4a-ea9635576789]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:14:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23261323739323436', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261323739323436', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1648411735',display_name='tempest-TestVolumeBootPattern-server-1648411735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1648411735',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-pyllp4a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:14:49Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:14:59 user nova-compute[72780]:   <uuid>9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf</uuid>
Aug 09 01:14:59 user nova-compute[72780]:   <name>instance-0000002c</name>
Aug 09 01:14:59 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:14:59 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:14:59 user nova-compute[72780]:   <metadata>
Aug 09 01:14:59 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:14:59 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:14:59 user nova-compute[72780]:       <nova:name>tempest-TestVolumeBootPattern-server-1648411735</nova:name>
Aug 09 01:14:59 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:14:57</nova:creationTime>
Aug 09 01:14:59 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:14:59 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:14:59 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:14:59 user nova-compute[72780]:       <nova:owner>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:user uuid="d54101aceab04126ba338c9965790cf3">tempest-TestVolumeBootPattern-1708118170-project-member</nova:user>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:project uuid="9933f68af5d6419e92195eb3b49687a8">tempest-TestVolumeBootPattern-1708118170</nova:project>
Aug 09 01:14:59 user nova-compute[72780]:       </nova:owner>
Aug 09 01:14:59 user nova-compute[72780]:       <nova:ports>
Aug 09 01:14:59 user nova-compute[72780]:         <nova:port uuid="6df50ef7-e282-4d9c-aa2d-7a372a0c2022">
Aug 09 01:14:59 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 01:14:59 user nova-compute[72780]:         </nova:port>
Aug 09 01:14:59 user nova-compute[72780]:       </nova:ports>
Aug 09 01:14:59 user nova-compute[72780]:     </nova:instance>
Aug 09 01:14:59 user nova-compute[72780]:   </metadata>
Aug 09 01:14:59 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:14:59 user nova-compute[72780]:     <system>
Aug 09 01:14:59 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:14:59 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:14:59 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:14:59 user nova-compute[72780]:       <entry name="serial">9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf</entry>
Aug 09 01:14:59 user nova-compute[72780]:       <entry name="uuid">9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf</entry>
Aug 09 01:14:59 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:14:59 user nova-compute[72780]:     </system>
Aug 09 01:14:59 user nova-compute[72780]:   </sysinfo>
Aug 09 01:14:59 user nova-compute[72780]:   <os>
Aug 09 01:14:59 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:14:59 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:14:59 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:14:59 user nova-compute[72780]:   </os>
Aug 09 01:14:59 user nova-compute[72780]:   <features>
Aug 09 01:14:59 user nova-compute[72780]:     <acpi/>
Aug 09 01:14:59 user nova-compute[72780]:     <apic/>
Aug 09 01:14:59 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:14:59 user nova-compute[72780]:   </features>
Aug 09 01:14:59 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:14:59 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:14:59 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:14:59 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:14:59 user nova-compute[72780]:   </clock>
Aug 09 01:14:59 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:14:59 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:14:59 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:14:59 user nova-compute[72780]:   </cpu>
Aug 09 01:14:59 user nova-compute[72780]:   <devices>
Aug 09 01:14:59 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:14:59 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:14:59 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 01:14:59 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:14:59 user nova-compute[72780]:       <serial>db25c212-bd25-4e1c-b4e7-c3a6b855035c</serial>
Aug 09 01:14:59 user nova-compute[72780]:     </disk>
Aug 09 01:14:59 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:14:59 user nova-compute[72780]:       <mac address="fa:16:3e:7b:d3:33"/>
Aug 09 01:14:59 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:59 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:14:59 user nova-compute[72780]:       <target dev="tap6df50ef7-e2"/>
Aug 09 01:14:59 user nova-compute[72780]:     </interface>
Aug 09 01:14:59 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:14:59 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf/console.log" append="off"/>
Aug 09 01:14:59 user nova-compute[72780]:     </serial>
Aug 09 01:14:59 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:14:59 user nova-compute[72780]:     <video>
Aug 09 01:14:59 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:14:59 user nova-compute[72780]:     </video>
Aug 09 01:14:59 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:14:59 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:14:59 user nova-compute[72780]:     </rng>
Aug 09 01:14:59 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:14:59 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:14:59 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:14:59 user nova-compute[72780]:     </memballoon>
Aug 09 01:14:59 user nova-compute[72780]:   </devices>
Aug 09 01:14:59 user nova-compute[72780]: </domain>
Aug 09 01:14:59 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1648411735',display_name='tempest-TestVolumeBootPattern-server-1648411735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1648411735',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-pyllp4a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:14:49Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG os_vif [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6df50ef7-e2, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6df50ef7-e2, col_values=(('external_ids', {'iface-id': '6df50ef7-e282-4d9c-aa2d-7a372a0c2022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:d3:33', 'vm-uuid': '9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:14:59 user nova-compute[72780]: INFO os_vif [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2')
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:14:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No VIF found with MAC fa:16:3e:7b:d3:33, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-ab326d96-fac1-43f0-b8ac-56ea28af0f46 req-0fd78038-9a88-4398-ac1a-20c0b0dca320 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab326d96-fac1-43f0-b8ac-56ea28af0f46 req-0fd78038-9a88-4398-ac1a-20c0b0dca320 service nova] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab326d96-fac1-43f0-b8ac-56ea28af0f46 req-0fd78038-9a88-4398-ac1a-20c0b0dca320 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab326d96-fac1-43f0-b8ac-56ea28af0f46 req-0fd78038-9a88-4398-ac1a-20c0b0dca320 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:00 user nova-compute[72780]: DEBUG nova.compute.manager [req-ab326d96-fac1-43f0-b8ac-56ea28af0f46 req-0fd78038-9a88-4398-ac1a-20c0b0dca320 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] No waiting events found dispatching network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:15:00 user nova-compute[72780]: WARNING nova.compute.manager [req-ab326d96-fac1-43f0-b8ac-56ea28af0f46 req-0fd78038-9a88-4398-ac1a-20c0b0dca320 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received unexpected event network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 for instance with vm_state building and task_state spawning.
Aug 09 01:15:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-92864344-5368-4a3b-856a-2898205fe950 req-5a30dc00-325b-4fc8-b3c0-cc3b089d7252 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92864344-5368-4a3b-856a-2898205fe950 req-5a30dc00-325b-4fc8-b3c0-cc3b089d7252 service nova] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92864344-5368-4a3b-856a-2898205fe950 req-5a30dc00-325b-4fc8-b3c0-cc3b089d7252 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-92864344-5368-4a3b-856a-2898205fe950 req-5a30dc00-325b-4fc8-b3c0-cc3b089d7252 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-92864344-5368-4a3b-856a-2898205fe950 req-5a30dc00-325b-4fc8-b3c0-cc3b089d7252 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] No waiting events found dispatching network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:15:03 user nova-compute[72780]: WARNING nova.compute.manager [req-92864344-5368-4a3b-856a-2898205fe950 req-5a30dc00-325b-4fc8-b3c0-cc3b089d7252 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received unexpected event network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 for instance with vm_state building and task_state spawning.
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543703.014914, 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] VM Resumed (Lifecycle Event)
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Instance spawned successfully.
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543703.0178256, 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] VM Started (Lifecycle Event)
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 09 01:15:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:15:03 user nova-compute[72780]: INFO nova.compute.manager [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Took 14.35 seconds to build instance.
Aug 09 01:15:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c33d8e22-5941-49fe-a8a9-4e8686836729 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.447s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:15:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:15:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:32 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:32 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:15:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:36 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:15:38 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:15:38 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7932MB free_disk=25.10137176513672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 841d4941-6521-453f-82ed-784ea088187f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d278c2f7-4424-49f1-8750-c2f88d0096b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 79a235e2-a374-4955-99bd-06a707295550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:15:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:15:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing instance network info cache due to event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:15:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:15:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:15:46 user nova-compute[72780]: DEBUG nova.network.neutron [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:15:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updated VIF entry in instance network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:15:47 user nova-compute[72780]: DEBUG nova.network.neutron [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:15:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-11e0333c-95cf-45fb-92e5-82a662702e55 req-9e765b4a-1df2-4b59-81c3-d49910dbaa2e service nova] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:15:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:15:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:55 user nova-compute[72780]: INFO nova.compute.manager [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Shelving
Aug 09 01:15:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-2a5b552a-4203-4251-b967-feaddcfdb5f1 req-cf8336e2-a968-4bb1-85c9-bb672e263de9 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2a5b552a-4203-4251-b967-feaddcfdb5f1 req-cf8336e2-a968-4bb1-85c9-bb672e263de9 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2a5b552a-4203-4251-b967-feaddcfdb5f1 req-cf8336e2-a968-4bb1-85c9-bb672e263de9 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2a5b552a-4203-4251-b967-feaddcfdb5f1 req-cf8336e2-a968-4bb1-85c9-bb672e263de9 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG nova.compute.manager [req-2a5b552a-4203-4251-b967-feaddcfdb5f1 req-cf8336e2-a968-4bb1-85c9-bb672e263de9 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:15:56 user nova-compute[72780]: WARNING nova.compute.manager [req-2a5b552a-4203-4251-b967-feaddcfdb5f1 req-cf8336e2-a968-4bb1-85c9-bb672e263de9 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state active and task_state shelving.
Aug 09 01:15:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:15:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance destroyed successfully.
Aug 09 01:15:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Beginning cold snapshot process
Aug 09 01:15:56 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:15:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk /opt/stack/data/nova/instances/snapshots/tmpun017psr/4c9f04f2ce324cdbbb92376a7a9a0bab {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:15:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk /opt/stack/data/nova/instances/snapshots/tmpun017psr/4c9f04f2ce324cdbbb92376a7a9a0bab" returned: 0 in 0.694s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:15:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Snapshot extracted, beginning image upload
Aug 09 01:15:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-a832501e-5531-4f0d-97e2-7905296cff69 req-ba010f12-e31a-42d4-a311-6bae60c18ca1 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:15:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a832501e-5531-4f0d-97e2-7905296cff69 req-ba010f12-e31a-42d4-a311-6bae60c18ca1 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:15:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a832501e-5531-4f0d-97e2-7905296cff69 req-ba010f12-e31a-42d4-a311-6bae60c18ca1 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:15:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a832501e-5531-4f0d-97e2-7905296cff69 req-ba010f12-e31a-42d4-a311-6bae60c18ca1 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:15:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-a832501e-5531-4f0d-97e2-7905296cff69 req-ba010f12-e31a-42d4-a311-6bae60c18ca1 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:15:58 user nova-compute[72780]: WARNING nova.compute.manager [req-a832501e-5531-4f0d-97e2-7905296cff69 req-ba010f12-e31a-42d4-a311-6bae60c18ca1 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 01:15:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Snapshot image upload complete
Aug 09 01:16:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:00 user nova-compute[72780]: INFO nova.compute.manager [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Shelve offloading
Aug 09 01:16:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance destroyed successfully.
Aug 09 01:16:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:16:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance destroyed successfully.
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'resources' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1775000355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1775000355',id=41,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhdtKTqLQZKty0d85BDuWqyX9TWWWgMYX73RdNXVOB5FK/I7CzhNiw+r6v+m5GaQ+dnt8PjtUliKD8KeDUrncDeJyH0qY9raQaf5G1hYaEXK7JHhMojREzYsxn6kaGgJg==',key_name='tempest-keypair-1784194185',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-0nabra6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member',shelved_at='2023-08-09T01:16:00.173198',shelved_host='user',shelved_image_id='6d57cee7-a584-44c9-a40d-319d812ebf9a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=841d4941-6521-453f-82ed-784ea088187f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG os_vif [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee7b8575-99, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:16:01 user nova-compute[72780]: INFO os_vif [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99')
Aug 09 01:16:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Deleting instance files /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f_del
Aug 09 01:16:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Deletion of /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f_del complete
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing instance network info cache due to event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:16:01 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Deleted allocations for instance 841d4941-6521-453f-82ed-784ea088187f
Aug 09 01:16:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'numa_topology' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:16:01 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:16:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c861ba8c-75cc-4111-b8f5-4fe16285b624 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.138s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updated VIF entry in instance network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:16:02 user nova-compute[72780]: DEBUG nova.network.neutron [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapee7b8575-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a1862af3-f29b-4595-ac86-24a0fbadee29 req-31ddd6a5-0227-444d-af10-54da2776cfce service nova] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-changed-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Refreshing instance network info cache due to event network-changed-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:16:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] Acquiring lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] Acquired lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Refreshing network info cache for port ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG nova.objects.instance [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'flavor' on Instance uuid d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:08 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Ignoring supplied device name: /dev/vdb
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.202s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:08 user nova-compute[72780]: INFO nova.compute.manager [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Attaching volume 2d91f5da-8f4e-4923-b4af-2b6abce56e22 to /dev/vdb
Aug 09 01:16:08 user nova-compute[72780]: DEBUG nova.network.neutron [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updated VIF entry in instance network info cache for port ced8d4b1-fe80-4cef-92bd-253b1f5aafbf. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG nova.network.neutron [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updating instance_info_cache with network_info: [{"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG os_brick.utils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7b804d41-9d9c-4178-b23b-68344bbf622a req-9838f3f9-c1d4-481c-9515-46daedacb609 service nova] Releasing lock "refresh_cache-d278c2f7-4424-49f1-8750-c2f88d0096b8" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8d2328-fa51-4ec3-9a0c-36b99adc022b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc211e9c-f056-450c-a85e-ba672ac0782d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbcc713-45ff-4044-8e23-17201eaa287f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[227067a9-2cab-4d02-9c85-fc489dfc05d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:16:08 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:16:08 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e6d7d9-7c43-4491-870a-60a9c36af14f]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG os_brick.utils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:08 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updating existing volume attachment record: 6751cd4c-208a-4827-9591-1f7d57faf611 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'flavor' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543756.7682927, 841d4941-6521-453f-82ed-784ea088187f => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:16:11 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] VM Stopped (Lifecycle Event)
Aug 09 01:16:11 user nova-compute[72780]: DEBUG nova.compute.manager [None req-eec74caf-7986-4607-aba3-76fb32e1f7ef None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:11 user nova-compute[72780]: INFO nova.compute.manager [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Attaching volume 8a4033db-70ed-4382-a529-9c2723051db7 to /dev/vdb
Aug 09 01:16:11 user nova-compute[72780]: DEBUG os_brick.utils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2043de3-1cd7-495d-94cf-ac6c66839f84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[97397d73-fe26-4860-a9fe-20a99bece804]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a47657-8fd7-41fd-b096-20441ed95e9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd296124-96b9-44c4-a5cb-b2affc0ec29c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:16:12 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:16:12 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9af02c-cbd7-4c03-9aa7-b0e327bc30a7]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG os_brick.utils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:12 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating existing volume attachment record: d5395282-9b6d-4837-a4f7-98b9acf86b03 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:16:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrBDclWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:18 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:18 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:18 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[70731e50-04f9-4318-a31d-59abb4e344df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:16:18 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8d3619-76f1-4df0-8e60-83a3ef6eed73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22] added
Aug 09 01:16:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c32d771-e5b5-428f-85bf-1077fca6fc06]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b5eea4-f0d5-4d28-b9a5-68571548e1fe]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrBDclWV {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrBDclWV" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae4cd46-7019-47bc-b7da-3e533bf45684]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrBDclWV'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d84b7-10fc-417c-89b5-25996f8684ff]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aae105-0f04-4760-8ca8-1b56c88fd2a8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe231164-973e-45dd-adaf-86096fe396e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260]
Aug 09 01:16:19 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260] successful.
Aug 09 01:16:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1526e03f-546e-40f6-9533-e6d405940d52]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f643029-d585-4543-a879-60ca364ae0a4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:19 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:19 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:19 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c181c5-1d72-42e6-9c9b-e290c01d37ef]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrBDclWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:19 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23362616533643263', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362616533643263', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.474s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:20 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:20 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'flavor' on Instance uuid d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef016d5-f0f9-4a35-906a-a67f842017e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:16:20 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:16:20 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:16:20 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:16:20 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:16:20 user nova-compute[72780]:   <serial>2d91f5da-8f4e-4923-b4af-2b6abce56e22</serial>
Aug 09 01:16:20 user nova-compute[72780]: </disk>
Aug 09 01:16:20 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a045a9-9577-434c-8a9a-6d9db179aff7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7] added
Aug 09 01:16:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed47a38-d91a-4d0c-b4de-800b75852f86]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c833a90a-af12-465f-81c5-d536b8bcbb69]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJBNlvaA {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJBNlvaA" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6123c0-4b86-4f79-b921-924a09060426]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJBNlvaA'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd57ce6-0688-42a5-8e3d-3f6d5345f782]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b56a2c5-06ce-4291-bcb6-5610d12f9746]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:20 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:20 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f82a5c-8f1c-4564-af82-2bccb55a4002]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]
Aug 09 01:16:20 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.
Aug 09 01:16:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fa3cd1-804b-4a5c-8c9c-8fffa255ad05]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c845224c-fd60-444d-aaca-e8555d34bcaa]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:20 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:20 user nova-compute[72780]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:20 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:20 user nova-compute[72780]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:20 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996e853-64dd-45eb-aa2c-4ac0c0b72844]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No VIF found with MAC fa:16:3e:ef:8c:cc, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:16:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9d4794d0-c2bd-4125-83d5-69901f722f3d tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.261s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== connect_volume: return (1806ms) {'type': 'block', 'scsi_wwn': '23263383532353164', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263383532353164', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'flavor' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:16:21 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:16:21 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 01:16:21 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:16:21 user nova-compute[72780]:   <serial>8a4033db-70ed-4382-a529-9c2723051db7</serial>
Aug 09 01:16:21 user nova-compute[72780]: </disk>
Aug 09 01:16:21 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:16:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:16:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:16:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No VIF found with MAC fa:16:3e:50:af:42, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:16:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3886e466-a1c1-4c70-ad18-13816a0e5b02 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.302s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing instance network info cache due to event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updated VIF entry in instance network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ecded3b6-1f42-4751-8bff-a1bf3bc6c538 req-cd875d14-098a-4ad6-a355-8a8b69163796 service nova] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:32 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing instance network info cache due to event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updated VIF entry in instance network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bd6e450f-b690-4f70-ad43-30008b1d5d3b req-7dd6e634-9775-4586-9560-f45eb9826d65 service nova] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:16:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:38 user nova-compute[72780]: INFO nova.compute.manager [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Rebooting instance
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-eefd486b-5473-468d-b807-78ae3ef23a4a req-003aa3b5-a304-493a-9303-b9156559ae71 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-unplugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-eefd486b-5473-468d-b807-78ae3ef23a4a req-003aa3b5-a304-493a-9303-b9156559ae71 service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-eefd486b-5473-468d-b807-78ae3ef23a4a req-003aa3b5-a304-493a-9303-b9156559ae71 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-eefd486b-5473-468d-b807-78ae3ef23a4a req-003aa3b5-a304-493a-9303-b9156559ae71 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-eefd486b-5473-468d-b807-78ae3ef23a4a req-003aa3b5-a304-493a-9303-b9156559ae71 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-unplugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:39 user nova-compute[72780]: WARNING nova.compute.manager [req-eefd486b-5473-468d-b807-78ae3ef23a4a req-003aa3b5-a304-493a-9303-b9156559ae71 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-unplugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:16:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance destroyed successfully.
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'resources' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1328901129',display_name='tempest-TestMinimumBasicScenario-server-1328901129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1328901129',id=43,image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTBb/f0tA7RQKiwVDK0Cqi8MzqeBz9KyvQg7X24229/5QBhHm4pVIDmfAxDXVl4OIu2jselLP0ZuXkiTiHKOjvUD+mTjCWHN/5Eq6e6/xD1rxlOc7fa74jFOX0jAQ11w==',key_name='tempest-TestMinimumBasicScenario-2041241445',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-m07gdzw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:16:39Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=79a235e2-a374-4955-99bd-06a707295550,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:16:39 user nova-compute[72780]: DEBUG os_vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7e45dad-42, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:16:40 user nova-compute[72780]: INFO os_vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42')
Aug 09 01:16:40 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:16:40 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8199MB free_disk=25.077621459960938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[998af0cd-2ba2-4f61-9863-af0901430934]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee2224e-9127-484a-bd2c-e8c63ffca94f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:40 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:40 user nova-compute[72780]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:40 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:40 user nova-compute[72780]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01d6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0557a0-950a-4515-a7f9-f148350ccf9b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d278c2f7-4424-49f1-8750-c2f88d0096b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 79a235e2-a374-4955-99bd-06a707295550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761d84d-0c01-46d3-b0b2-edb2284c6e68]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e53a1-61b0-4dfd-84fa-aebbb09650a5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff3dccc-7fa9-4c59-a9ed-a4f9860c0738]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c1157-c329-4890-93f6-dc5dc22d2aa6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b0574c-83d6-42d9-a623-7842c90989e5]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]
Aug 09 01:16:40 user nova-compute[72780]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.
Aug 09 01:16:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252c760-a08c-43d0-8ace-af2b7bd92ad7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== disconnect_volume: return (335ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Start _get_guest_xml network_info=[{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=762e0ae3-efa6-446e-900b-b85908e10dca,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '762e0ae3-efa6-446e-900b-b85908e10dca'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '79a235e2-a374-4955-99bd-06a707295550', 'attached_at': '', 'detached_at': '', 'volume_id': '8a4033db-70ed-4382-a529-9c2723051db7', 'serial': '8a4033db-70ed-4382-a529-9c2723051db7'}, 'disk_bus': 'virtio', 'attachment_id': 'd5395282-9b6d-4837-a4f7-98b9acf86b03', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:16:40 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:16:40 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=762e0ae3-efa6-446e-900b-b85908e10dca,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'vcpu_model' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:40 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:40 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6642b40a-29fd-4d8f-ad3d-c4ca2353cc54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:16:40 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759107d-676a-4d14-8599-3c0830711bd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7] added
Aug 09 01:16:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9136e72f-ce8b-4159-b440-5f72484d6de3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05cfd52-39e3-44c4-adee-31d611f4bad3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-changed-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Refreshing instance network info cache due to event network-changed-6df50ef7-e282-4d9c-aa2d-7a372a0c2022. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] Acquiring lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] Acquired lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG nova.network.neutron [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Refreshing network info cache for port 6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJBNlvaA {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJBNlvaA" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118e5eb-b333-4fa0-a67d-63920549c137]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJBNlvaA'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[868be9bb-2b5e-4eec-bb65-8de48a2511de]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f6b22b-97d0-434f-ac95-7df04aa7628a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:40 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:40 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:40 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f5625-8ad8-48e6-8508-252e94596b4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]
Aug 09 01:16:41 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.
Aug 09 01:16:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f661070-c580-4d77-9330-b00f0f934164]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795cede-0ee2-432a-909f-77b13905e470]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:41 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:41 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:41 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:41 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:41 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c27d2-3db9-4a34-a2b2-5cb2d3f89772]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG nova.network.neutron [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updated VIF entry in instance network info cache for port 6df50ef7-e282-4d9c-aa2d-7a372a0c2022. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG nova.network.neutron [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating instance_info_cache with network_info: [{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8fdca7b7-ef99-453d-b157-d23e4de50cb1 req-14348b0e-fd0e-4e45-8016-0026436b035a service nova] Releasing lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-f7654a0a-0755-4f77-974a-f218d816c6a3 req-b38bc77c-a8f9-4367-9973-d909cbfd432d service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f7654a0a-0755-4f77-974a-f218d816c6a3 req-b38bc77c-a8f9-4367-9973-d909cbfd432d service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f7654a0a-0755-4f77-974a-f218d816c6a3 req-b38bc77c-a8f9-4367-9973-d909cbfd432d service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f7654a0a-0755-4f77-974a-f218d816c6a3 req-b38bc77c-a8f9-4367-9973-d909cbfd432d service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-f7654a0a-0755-4f77-974a-f218d816c6a3 req-b38bc77c-a8f9-4367-9973-d909cbfd432d service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:41 user nova-compute[72780]: WARNING nova.compute.manager [req-f7654a0a-0755-4f77-974a-f218d816c6a3 req-b38bc77c-a8f9-4367-9973-d909cbfd432d service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 01:16:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23263383532353164', 'path': '/dev/sdd'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263383532353164', 'path': '/dev/sdd'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1328901129',display_name='tempest-TestMinimumBasicScenario-server-1328901129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1328901129',id=43,image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTBb/f0tA7RQKiwVDK0Cqi8MzqeBz9KyvQg7X24229/5QBhHm4pVIDmfAxDXVl4OIu2jselLP0ZuXkiTiHKOjvUD+mTjCWHN/5Eq6e6/xD1rxlOc7fa74jFOX0jAQ11w==',key_name='tempest-TestMinimumBasicScenario-2041241445',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-m07gdzw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:16:39Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=79a235e2-a374-4955-99bd-06a707295550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'pci_devices' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:16:42 user nova-compute[72780]:   <uuid>79a235e2-a374-4955-99bd-06a707295550</uuid>
Aug 09 01:16:42 user nova-compute[72780]:   <name>instance-0000002b</name>
Aug 09 01:16:42 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:16:42 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:16:42 user nova-compute[72780]:   <metadata>
Aug 09 01:16:42 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:16:42 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:16:42 user nova-compute[72780]:       <nova:name>tempest-TestMinimumBasicScenario-server-1328901129</nova:name>
Aug 09 01:16:42 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:16:40</nova:creationTime>
Aug 09 01:16:42 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:16:42 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:16:42 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:16:42 user nova-compute[72780]:       <nova:owner>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:user uuid="b17e92fe6f4141a19ae4fa94c24eec52">tempest-TestMinimumBasicScenario-546637949-project-member</nova:user>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:project uuid="a85055d2cc3d47fdb496d109879dcf2c">tempest-TestMinimumBasicScenario-546637949</nova:project>
Aug 09 01:16:42 user nova-compute[72780]:       </nova:owner>
Aug 09 01:16:42 user nova-compute[72780]:       <nova:root type="image" uuid="762e0ae3-efa6-446e-900b-b85908e10dca"/>
Aug 09 01:16:42 user nova-compute[72780]:       <nova:ports>
Aug 09 01:16:42 user nova-compute[72780]:         <nova:port uuid="c7e45dad-4206-4406-ab14-ad04ba3a283f">
Aug 09 01:16:42 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 01:16:42 user nova-compute[72780]:         </nova:port>
Aug 09 01:16:42 user nova-compute[72780]:       </nova:ports>
Aug 09 01:16:42 user nova-compute[72780]:     </nova:instance>
Aug 09 01:16:42 user nova-compute[72780]:   </metadata>
Aug 09 01:16:42 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:16:42 user nova-compute[72780]:     <system>
Aug 09 01:16:42 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:16:42 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:16:42 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:16:42 user nova-compute[72780]:       <entry name="serial">79a235e2-a374-4955-99bd-06a707295550</entry>
Aug 09 01:16:42 user nova-compute[72780]:       <entry name="uuid">79a235e2-a374-4955-99bd-06a707295550</entry>
Aug 09 01:16:42 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:16:42 user nova-compute[72780]:     </system>
Aug 09 01:16:42 user nova-compute[72780]:   </sysinfo>
Aug 09 01:16:42 user nova-compute[72780]:   <os>
Aug 09 01:16:42 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:16:42 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:16:42 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:16:42 user nova-compute[72780]:   </os>
Aug 09 01:16:42 user nova-compute[72780]:   <features>
Aug 09 01:16:42 user nova-compute[72780]:     <acpi/>
Aug 09 01:16:42 user nova-compute[72780]:     <apic/>
Aug 09 01:16:42 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:16:42 user nova-compute[72780]:   </features>
Aug 09 01:16:42 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:16:42 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:16:42 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:16:42 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:16:42 user nova-compute[72780]:   </clock>
Aug 09 01:16:42 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:16:42 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:16:42 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:16:42 user nova-compute[72780]:   </cpu>
Aug 09 01:16:42 user nova-compute[72780]:   <devices>
Aug 09 01:16:42 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:16:42 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:16:42 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk"/>
Aug 09 01:16:42 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:16:42 user nova-compute[72780]:     </disk>
Aug 09 01:16:42 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:16:42 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:16:42 user nova-compute[72780]:       <source dev="/dev/sdd"/>
Aug 09 01:16:42 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:16:42 user nova-compute[72780]:       <serial>8a4033db-70ed-4382-a529-9c2723051db7</serial>
Aug 09 01:16:42 user nova-compute[72780]:     </disk>
Aug 09 01:16:42 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:16:42 user nova-compute[72780]:       <mac address="fa:16:3e:50:af:42"/>
Aug 09 01:16:42 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:16:42 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:16:42 user nova-compute[72780]:       <target dev="tapc7e45dad-42"/>
Aug 09 01:16:42 user nova-compute[72780]:     </interface>
Aug 09 01:16:42 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:16:42 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/console.log" append="off"/>
Aug 09 01:16:42 user nova-compute[72780]:     </serial>
Aug 09 01:16:42 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:16:42 user nova-compute[72780]:     <video>
Aug 09 01:16:42 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:16:42 user nova-compute[72780]:     </video>
Aug 09 01:16:42 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:16:42 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:16:42 user nova-compute[72780]:     </rng>
Aug 09 01:16:42 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:16:42 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:16:42 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:16:42 user nova-compute[72780]:     </memballoon>
Aug 09 01:16:42 user nova-compute[72780]:   </devices>
Aug 09 01:16:42 user nova-compute[72780]: </domain>
Aug 09 01:16:42 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'trusted_certs' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Cannot resize image /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'migration_context' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1328901129',display_name='tempest-TestMinimumBasicScenario-server-1328901129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1328901129',id=43,image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTBb/f0tA7RQKiwVDK0Cqi8MzqeBz9KyvQg7X24229/5QBhHm4pVIDmfAxDXVl4OIu2jselLP0ZuXkiTiHKOjvUD+mTjCWHN/5Eq6e6/xD1rxlOc7fa74jFOX0jAQ11w==',key_name='tempest-TestMinimumBasicScenario-2041241445',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-m07gdzw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:16:39Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=79a235e2-a374-4955-99bd-06a707295550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG os_vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7e45dad-42, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7e45dad-42, col_values=(('external_ids', {'iface-id': 'c7e45dad-4206-4406-ab14-ad04ba3a283f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:af:42', 'vm-uuid': '79a235e2-a374-4955-99bd-06a707295550'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:16:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:42 user nova-compute[72780]: INFO os_vif [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42')
Aug 09 01:16:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-62bd93e0-8e3a-4ca1-9043-d6b78d09bdb6 req-2fc7440a-9683-4fba-a55d-0a26b3c5668e service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-62bd93e0-8e3a-4ca1-9043-d6b78d09bdb6 req-2fc7440a-9683-4fba-a55d-0a26b3c5668e service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-62bd93e0-8e3a-4ca1-9043-d6b78d09bdb6 req-2fc7440a-9683-4fba-a55d-0a26b3c5668e service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-62bd93e0-8e3a-4ca1-9043-d6b78d09bdb6 req-2fc7440a-9683-4fba-a55d-0a26b3c5668e service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-62bd93e0-8e3a-4ca1-9043-d6b78d09bdb6 req-2fc7440a-9683-4fba-a55d-0a26b3c5668e service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:44 user nova-compute[72780]: WARNING nova.compute.manager [req-62bd93e0-8e3a-4ca1-9043-d6b78d09bdb6 req-2fc7440a-9683-4fba-a55d-0a26b3c5668e service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for 79a235e2-a374-4955-99bd-06a707295550 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543806.42063, 79a235e2-a374-4955-99bd-06a707295550 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:16:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] VM Resumed (Lifecycle Event)
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:16:46 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance rebooted successfully.
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:16:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543806.4247112, 79a235e2-a374-4955-99bd-06a707295550 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:16:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] VM Started (Lifecycle Event)
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:16:46 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 01:16:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-caaf3c76-5b57-4f44-845b-7c9aff5cc80e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.369s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-b00dcf29-8ec7-4807-9fbc-d93859837b63 req-7a28445c-d109-4716-872a-3d69bb12648c service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b00dcf29-8ec7-4807-9fbc-d93859837b63 req-7a28445c-d109-4716-872a-3d69bb12648c service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b00dcf29-8ec7-4807-9fbc-d93859837b63 req-7a28445c-d109-4716-872a-3d69bb12648c service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b00dcf29-8ec7-4807-9fbc-d93859837b63 req-7a28445c-d109-4716-872a-3d69bb12648c service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-b00dcf29-8ec7-4807-9fbc-d93859837b63 req-7a28445c-d109-4716-872a-3d69bb12648c service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:46 user nova-compute[72780]: WARNING nova.compute.manager [req-b00dcf29-8ec7-4807-9fbc-d93859837b63 req-7a28445c-d109-4716-872a-3d69bb12648c service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state active and task_state None.
Aug 09 01:16:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:54 user nova-compute[72780]: INFO nova.compute.manager [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Rescuing
Aug 09 01:16:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG nova.network.neutron [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:54 user nova-compute[72780]: INFO nova.compute.manager [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Detaching volume 2d91f5da-8f4e-4923-b4af-2b6abce56e22
Aug 09 01:16:54 user nova-compute[72780]: INFO nova.virt.block_device [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Attempting to driver detach volume 2d91f5da-8f4e-4923-b4af-2b6abce56e22 from mountpoint /dev/vdb
Aug 09 01:16:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Attempting to detach device vdb from instance d278c2f7-4424-49f1-8750-c2f88d0096b8 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:16:54 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:16:54 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:16:54 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:16:54 user nova-compute[72780]:   <serial>2d91f5da-8f4e-4923-b4af-2b6abce56e22</serial>
Aug 09 01:16:54 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:16:54 user nova-compute[72780]: </disk>
Aug 09 01:16:54 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:54 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully detached device vdb from instance d278c2f7-4424-49f1-8750-c2f88d0096b8 from the persistent domain config.
Aug 09 01:16:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d278c2f7-4424-49f1-8750-c2f88d0096b8 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:16:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:16:54 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:16:54 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:16:54 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:16:54 user nova-compute[72780]:   <serial>2d91f5da-8f4e-4923-b4af-2b6abce56e22</serial>
Aug 09 01:16:54 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:16:54 user nova-compute[72780]: </disk>
Aug 09 01:16:54 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.network.neutron [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543815.3239448, d278c2f7-4424-49f1-8750-c2f88d0096b8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:16:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully detached device vdb from instance d278c2f7-4424-49f1-8750-c2f88d0096b8 from the live domain config.
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrBDclWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:55 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a59be33-8d1e-4c5e-b6a6-49982417be64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b626816-7412-45f6-8ae4-544a685ad74d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:55 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:55 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:55 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:55 user nova-compute[72780]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 (non-flash)
Aug 09 01:16:55 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:55 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa0687520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[25693ba2-aff4-4be9-b88b-1d6355322039]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[025e9775-9175-4795-a10d-8001e480d7b2]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[989692a8-1c95-4d82-b1bd-f5a6b5dcb292]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-ff4066d3-9ac0-4174-970c-b90d9049b43c req-a29295a7-76f3-41a2-969d-60cf51f22681 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ff4066d3-9ac0-4174-970c-b90d9049b43c req-a29295a7-76f3-41a2-969d-60cf51f22681 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ff4066d3-9ac0-4174-970c-b90d9049b43c req-a29295a7-76f3-41a2-969d-60cf51f22681 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ff4066d3-9ac0-4174-970c-b90d9049b43c req-a29295a7-76f3-41a2-969d-60cf51f22681 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.compute.manager [req-ff4066d3-9ac0-4174-970c-b90d9049b43c req-a29295a7-76f3-41a2-969d-60cf51f22681 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:55 user nova-compute[72780]: WARNING nova.compute.manager [req-ff4066d3-9ac0-4174-970c-b90d9049b43c req-a29295a7-76f3-41a2-969d-60cf51f22681 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state active and task_state rescuing.
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[589d41dc-cb49-43d3-8c6a-55f48f164d18]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9292ac39-fc10-4464-9fdf-162b0093ab1a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ffe67-3e6d-445b-af29-bab291be24fb]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260]
Aug 09 01:16:55 user nova-compute[72780]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22, portal: 172.16.0.220,3260] successful.
Aug 09 01:16:55 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b5834f-9b90-4c6d-9fac-359b0159cbcb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== disconnect_volume: return (297ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:16:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance destroyed successfully.
Aug 09 01:16:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Attempting rescue
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72780) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 01:16:55 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Creating image(s)
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:55 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue" returned: 0 in 0.055s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'migration_context' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Start _get_guest_xml network_info=[{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:8c:50:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'resources' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'numa_topology' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:16:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181529430',display_name='tempest-ServerRescueNegativeTestJSON-server-1181529430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181529430',id=39,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-2xb7aij0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:12:15Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=f2b9c8e3-3ca7-452d-a586-11130fa4442a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:8c:50:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:8c:50:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:16:56 user nova-compute[72780]:   <uuid>f2b9c8e3-3ca7-452d-a586-11130fa4442a</uuid>
Aug 09 01:16:56 user nova-compute[72780]:   <name>instance-00000027</name>
Aug 09 01:16:56 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:16:56 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:16:56 user nova-compute[72780]:   <metadata>
Aug 09 01:16:56 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:16:56 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:16:56 user nova-compute[72780]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1181529430</nova:name>
Aug 09 01:16:56 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:16:56</nova:creationTime>
Aug 09 01:16:56 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:16:56 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:16:56 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:16:56 user nova-compute[72780]:       <nova:owner>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:user uuid="59257e56086046b0a27ce3880c309586">tempest-ServerRescueNegativeTestJSON-1588572554-project-member</nova:user>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:project uuid="b9784ac1238a41e598ec36907111c770">tempest-ServerRescueNegativeTestJSON-1588572554</nova:project>
Aug 09 01:16:56 user nova-compute[72780]:       </nova:owner>
Aug 09 01:16:56 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:16:56 user nova-compute[72780]:       <nova:ports>
Aug 09 01:16:56 user nova-compute[72780]:         <nova:port uuid="875e2936-190d-4d22-83bb-45e92e3737ea">
Aug 09 01:16:56 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 01:16:56 user nova-compute[72780]:         </nova:port>
Aug 09 01:16:56 user nova-compute[72780]:       </nova:ports>
Aug 09 01:16:56 user nova-compute[72780]:     </nova:instance>
Aug 09 01:16:56 user nova-compute[72780]:   </metadata>
Aug 09 01:16:56 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:16:56 user nova-compute[72780]:     <system>
Aug 09 01:16:56 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:16:56 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:16:56 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:16:56 user nova-compute[72780]:       <entry name="serial">f2b9c8e3-3ca7-452d-a586-11130fa4442a</entry>
Aug 09 01:16:56 user nova-compute[72780]:       <entry name="uuid">f2b9c8e3-3ca7-452d-a586-11130fa4442a</entry>
Aug 09 01:16:56 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:16:56 user nova-compute[72780]:     </system>
Aug 09 01:16:56 user nova-compute[72780]:   </sysinfo>
Aug 09 01:16:56 user nova-compute[72780]:   <os>
Aug 09 01:16:56 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:16:56 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:16:56 user nova-compute[72780]:   </os>
Aug 09 01:16:56 user nova-compute[72780]:   <features>
Aug 09 01:16:56 user nova-compute[72780]:     <acpi/>
Aug 09 01:16:56 user nova-compute[72780]:     <apic/>
Aug 09 01:16:56 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:16:56 user nova-compute[72780]:   </features>
Aug 09 01:16:56 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:16:56 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:16:56 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:16:56 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:16:56 user nova-compute[72780]:   </clock>
Aug 09 01:16:56 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:16:56 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:16:56 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:16:56 user nova-compute[72780]:   </cpu>
Aug 09 01:16:56 user nova-compute[72780]:   <devices>
Aug 09 01:16:56 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:16:56 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:16:56 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue"/>
Aug 09 01:16:56 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:16:56 user nova-compute[72780]:     </disk>
Aug 09 01:16:56 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:16:56 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:16:56 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk"/>
Aug 09 01:16:56 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:16:56 user nova-compute[72780]:     </disk>
Aug 09 01:16:56 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:16:56 user nova-compute[72780]:       <mac address="fa:16:3e:8c:50:36"/>
Aug 09 01:16:56 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:16:56 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:16:56 user nova-compute[72780]:       <target dev="tap875e2936-19"/>
Aug 09 01:16:56 user nova-compute[72780]:     </interface>
Aug 09 01:16:56 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:16:56 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/console.log" append="off"/>
Aug 09 01:16:56 user nova-compute[72780]:     </serial>
Aug 09 01:16:56 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:16:56 user nova-compute[72780]:     <video>
Aug 09 01:16:56 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:16:56 user nova-compute[72780]:     </video>
Aug 09 01:16:56 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:16:56 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:16:56 user nova-compute[72780]:     </rng>
Aug 09 01:16:56 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:16:56 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:16:56 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:16:56 user nova-compute[72780]:     </memballoon>
Aug 09 01:16:56 user nova-compute[72780]:   </devices>
Aug 09 01:16:56 user nova-compute[72780]: </domain>
Aug 09 01:16:56 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance destroyed successfully.
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:8c:50:36, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:16:56 user nova-compute[72780]: INFO nova.compute.claims [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Claim successful on node user
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'flavor' on Instance uuid d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c730555c-1830-4e58-b09d-af0639af79b7 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.601s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:56 user nova-compute[72780]: INFO nova.compute.manager [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Terminating instance
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:16:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG nova.policy [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54101aceab04126ba338c9965790cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9933f68af5d6419e92195eb3b49687a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:16:56 user nova-compute[72780]: INFO nova.virt.block_device [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Booting with volume 01c852af-b86c-4c5f-8ea3-7ca841ba4993 at /dev/vda
Aug 09 01:16:56 user nova-compute[72780]: DEBUG os_brick.utils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2644b64-d20a-4570-af24-147d3d37ea74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae4ba92-689d-4f0a-8855-7fe4d5dd1d15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:56 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b899f-3160-4674-9e30-ede12b57a845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45646ee-3a5d-4c09-ba1a-774875e72bbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:16:57 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebadff92-2833-49b5-9226-998f4d497f24]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.utils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updating existing volume attachment record: 7a9f3c99-c080-4726-8b0d-76d3b4af938f {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Successfully created port: d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:57 user nova-compute[72780]: WARNING nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state active and task_state rescuing.
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-vif-unplugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] No waiting events found dispatching network-vif-unplugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-vif-unplugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Acquiring lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] No waiting events found dispatching network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:57 user nova-compute[72780]: WARNING nova.compute.manager [req-b889315d-cd2d-4e5c-88d1-dc6e17a4fc82 req-bb47d7bd-a31a-437b-bbcf-dd19d720e8cc service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received unexpected event network-vif-plugged-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf for instance with vm_state active and task_state deleting.
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Instance destroyed successfully.
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.objects.instance [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'resources' on Instance uuid d278c2f7-4424-49f1-8750-c2f88d0096b8 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2046210217',display_name='tempest-VolumesSnapshotTestJSON-instance-2046210217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2046210217',id=42,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgvt4LeKa9LfZwoA6QHOgOTlqR7p7L91+DpfXb9NtwqUC1BMxL96/ePzVIgeK20cDl7deQRs4BKKsXSQfb9ofvgk9lojXnI05kBkgLuZ6k05agH7si6EU1DHF/GNiOiA==',key_name='tempest-keypair-1507486502',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16197c0497354e32b5ead73377548f30',ramdisk_id='',reservation_id='r-tlbg2x1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-468237489',owner_user_name='tempest-VolumesSnapshotTestJSON-468237489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ec6e6c8ce14879a1397fec6429c4d1',uuid=d278c2f7-4424-49f1-8750-c2f88d0096b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converting VIF {"id": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "address": "fa:16:3e:ef:8c:cc", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d4b1-fe", "ovs_interfaceid": "ced8d4b1-fe80-4cef-92bd-253b1f5aafbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_vif [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced8d4b1-fe, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: INFO os_vif [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:8c:cc,bridge_name='br-int',has_traffic_filtering=True,id=ced8d4b1-fe80-4cef-92bd-253b1f5aafbf,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d4b1-fe')
Aug 09 01:16:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrBDclWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:16:57 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d91f5da-8f4e-4923-b4af-2b6abce56e22', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26dc95f-407a-453f-b5ff-993737e7e559]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c4d3d3-66cb-4e55-88d8-ce081517a3f0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:58 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:16:58 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:16:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ae64c9480>, {}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Disconnecting from: [] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== disconnect_volume: return (80ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:16:58 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Deleting instance files /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8_del
Aug 09 01:16:58 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Deletion of /opt/stack/data/nova/instances/d278c2f7-4424-49f1-8750-c2f88d0096b8_del complete
Aug 09 01:16:58 user nova-compute[72780]: INFO nova.compute.manager [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Took 1.62 seconds to destroy the instance on the hypervisor.
Aug 09 01:16:58 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Successfully updated port: d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-changed-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.compute.manager [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Refreshing instance network info cache due to event network-changed-d4196123-ed0c-4907-90f7-c5d4253e9361. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] Acquiring lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] Acquired lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.network.neutron [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Refreshing network info cache for port d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:16:58 user nova-compute[72780]: DEBUG nova.network.neutron [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.network.neutron [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-115332f8-4f3a-4d0e-b8bd-355ffa9cd72f req-20a666a4-229c-4ca5-b2c1-690b1b3e87bb service nova] Releasing lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquired lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:59 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Took 1.18 seconds to deallocate network for instance.
Aug 09 01:16:59 user nova-compute[72780]: WARNING nova.volume.cinder [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Attachment 6751cd4c-208a-4827-9591-1f7d57faf611 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6751cd4c-208a-4827-9591-1f7d57faf611. (HTTP 404) (Request-ID: req-1d79954e-af4c-4045-b378-208abdaa5490)
Aug 09 01:16:59 user nova-compute[72780]: INFO nova.compute.manager [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:59 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Deleted allocations for instance d278c2f7-4424-49f1-8750-c2f88d0096b8
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:59 user nova-compute[72780]: WARNING nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state active and task_state rescuing.
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:16:59 user nova-compute[72780]: WARNING nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state active and task_state rescuing.
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e76a74a-a5cb-40bf-b5b4-7388ce6127c3 req-3df6f81c-01c3-4567-b1ec-2bc13b522a15 service nova] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Received event network-vif-deleted-ced8d4b1-fe80-4cef-92bd-253b1f5aafbf {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-94d33f93-199c-4771-b688-c13ad0a71e1a tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "d278c2f7-4424-49f1-8750-c2f88d0096b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.281s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updating instance_info_cache with network_info: [{"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Releasing lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:16:59 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Instance network_info: |[{"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for f2b9c8e3-3ca7-452d-a586-11130fa4442a due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543820.2772775, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:17:00 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Resumed (Lifecycle Event)
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-250447a9-4d0a-4ef9-b35c-c1c6a658a617 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:17:00 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543820.278363, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:17:00 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Started (Lifecycle Event)
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:17:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:17:05 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Creating image(s)
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Ensure instance console log exists: /opt/stack/data/nova/instances/1d85dc06-0278-4210-bf6d-52b07c3eb75e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Start _get_guest_xml network_info=[{"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdFwpGeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d85dc06-0278-4210-bf6d-52b07c3eb75e', 'attached_at': '', 'detached_at': '', 'volume_id': '01c852af-b86c-4c5f-8ea3-7ca841ba4993', 'serial': '01c852af-b86c-4c5f-8ea3-7ca841ba4993'}, 'disk_bus': 'virtio', 'attachment_id': '7a9f3c99-c080-4726-8b0d-76d3b4af938f', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:17:05 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:17:05 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdFwpGeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:17:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:17:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:17:05 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abb2c41-9626-4d91-a9b3-c5a37eeb88c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:17:05 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b556e4-cb7e-4df3-afa8-c5c14e258608]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993] added
Aug 09 01:17:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33bf0be-1ab4-4f7f-b468-353ea961a339]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d55353-1180-4192-a144-897e43e81f1a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdFwpGeK {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdFwpGeK" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df36ec44-6a91-407f-a507-56e91616ec92]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdFwpGeK'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9e56f3-73bf-4a21-93be-f0e6aa977987]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab69ec-2ad9-456f-9d22-22de09c0a864]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:17:05 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:17:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:17:05 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:17:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905e236-7fdf-4a82-b8b2-4acb69dac448]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260]
Aug 09 01:17:05 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260] successful.
Aug 09 01:17:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbcf6e3-8a4e-418d-a2d3-fd8a8ce870d0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc41f3-22fe-4158-9add-9e8d8ec94920]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:17:05 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:17:05 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:17:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:17:05 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:17:05 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:17:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a1116-b8aa-491e-a6b8-a2564001dc22]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:05 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdFwpGeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23531636534356637', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531636534356637', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-944096451',display_name='tempest-TestVolumeBootPattern-server-944096451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-944096451',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-ff8j2n66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:16:57Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=1d85dc06-0278-4210-bf6d-52b07c3eb75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d85dc06-0278-4210-bf6d-52b07c3eb75e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:17:06 user nova-compute[72780]:   <uuid>1d85dc06-0278-4210-bf6d-52b07c3eb75e</uuid>
Aug 09 01:17:06 user nova-compute[72780]:   <name>instance-0000002d</name>
Aug 09 01:17:06 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:17:06 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:17:06 user nova-compute[72780]:   <metadata>
Aug 09 01:17:06 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:17:06 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:17:06 user nova-compute[72780]:       <nova:name>tempest-TestVolumeBootPattern-server-944096451</nova:name>
Aug 09 01:17:06 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:17:05</nova:creationTime>
Aug 09 01:17:06 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:17:06 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:17:06 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:17:06 user nova-compute[72780]:       <nova:owner>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:user uuid="d54101aceab04126ba338c9965790cf3">tempest-TestVolumeBootPattern-1708118170-project-member</nova:user>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:project uuid="9933f68af5d6419e92195eb3b49687a8">tempest-TestVolumeBootPattern-1708118170</nova:project>
Aug 09 01:17:06 user nova-compute[72780]:       </nova:owner>
Aug 09 01:17:06 user nova-compute[72780]:       <nova:ports>
Aug 09 01:17:06 user nova-compute[72780]:         <nova:port uuid="d4196123-ed0c-4907-90f7-c5d4253e9361">
Aug 09 01:17:06 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 01:17:06 user nova-compute[72780]:         </nova:port>
Aug 09 01:17:06 user nova-compute[72780]:       </nova:ports>
Aug 09 01:17:06 user nova-compute[72780]:     </nova:instance>
Aug 09 01:17:06 user nova-compute[72780]:   </metadata>
Aug 09 01:17:06 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:17:06 user nova-compute[72780]:     <system>
Aug 09 01:17:06 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:17:06 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:17:06 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:17:06 user nova-compute[72780]:       <entry name="serial">1d85dc06-0278-4210-bf6d-52b07c3eb75e</entry>
Aug 09 01:17:06 user nova-compute[72780]:       <entry name="uuid">1d85dc06-0278-4210-bf6d-52b07c3eb75e</entry>
Aug 09 01:17:06 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:17:06 user nova-compute[72780]:     </system>
Aug 09 01:17:06 user nova-compute[72780]:   </sysinfo>
Aug 09 01:17:06 user nova-compute[72780]:   <os>
Aug 09 01:17:06 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:17:06 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:17:06 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:17:06 user nova-compute[72780]:   </os>
Aug 09 01:17:06 user nova-compute[72780]:   <features>
Aug 09 01:17:06 user nova-compute[72780]:     <acpi/>
Aug 09 01:17:06 user nova-compute[72780]:     <apic/>
Aug 09 01:17:06 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:17:06 user nova-compute[72780]:   </features>
Aug 09 01:17:06 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:17:06 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:17:06 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:17:06 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:17:06 user nova-compute[72780]:   </clock>
Aug 09 01:17:06 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:17:06 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:17:06 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:17:06 user nova-compute[72780]:   </cpu>
Aug 09 01:17:06 user nova-compute[72780]:   <devices>
Aug 09 01:17:06 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:17:06 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:17:06 user nova-compute[72780]:       <source dev="/dev/sdc"/>
Aug 09 01:17:06 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:17:06 user nova-compute[72780]:       <serial>01c852af-b86c-4c5f-8ea3-7ca841ba4993</serial>
Aug 09 01:17:06 user nova-compute[72780]:     </disk>
Aug 09 01:17:06 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:17:06 user nova-compute[72780]:       <mac address="fa:16:3e:25:db:f0"/>
Aug 09 01:17:06 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:17:06 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:17:06 user nova-compute[72780]:       <target dev="tapd4196123-ed"/>
Aug 09 01:17:06 user nova-compute[72780]:     </interface>
Aug 09 01:17:06 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:17:06 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/1d85dc06-0278-4210-bf6d-52b07c3eb75e/console.log" append="off"/>
Aug 09 01:17:06 user nova-compute[72780]:     </serial>
Aug 09 01:17:06 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:17:06 user nova-compute[72780]:     <video>
Aug 09 01:17:06 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:17:06 user nova-compute[72780]:     </video>
Aug 09 01:17:06 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:17:06 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:17:06 user nova-compute[72780]:     </rng>
Aug 09 01:17:06 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:17:06 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:17:06 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:17:06 user nova-compute[72780]:     </memballoon>
Aug 09 01:17:06 user nova-compute[72780]:   </devices>
Aug 09 01:17:06 user nova-compute[72780]: </domain>
Aug 09 01:17:06 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-944096451',display_name='tempest-TestVolumeBootPattern-server-944096451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-944096451',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-ff8j2n66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:16:57Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=1d85dc06-0278-4210-bf6d-52b07c3eb75e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG os_vif [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4196123-ed, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4196123-ed, col_values=(('external_ids', {'iface-id': 'd4196123-ed0c-4907-90f7-c5d4253e9361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:db:f0', 'vm-uuid': '1d85dc06-0278-4210-bf6d-52b07c3eb75e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:17:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:06 user nova-compute[72780]: INFO os_vif [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed')
Aug 09 01:17:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:17:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] No VIF found with MAC fa:16:3e:25:db:f0, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-b343fbe5-828f-4a0a-9bc8-65455a2c0b04 req-79ed4826-8c01-4dd9-add8-7b5c1bbf1902 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b343fbe5-828f-4a0a-9bc8-65455a2c0b04 req-79ed4826-8c01-4dd9-add8-7b5c1bbf1902 service nova] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b343fbe5-828f-4a0a-9bc8-65455a2c0b04 req-79ed4826-8c01-4dd9-add8-7b5c1bbf1902 service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b343fbe5-828f-4a0a-9bc8-65455a2c0b04 req-79ed4826-8c01-4dd9-add8-7b5c1bbf1902 service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG nova.compute.manager [req-b343fbe5-828f-4a0a-9bc8-65455a2c0b04 req-79ed4826-8c01-4dd9-add8-7b5c1bbf1902 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] No waiting events found dispatching network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:17:08 user nova-compute[72780]: WARNING nova.compute.manager [req-b343fbe5-828f-4a0a-9bc8-65455a2c0b04 req-79ed4826-8c01-4dd9-add8-7b5c1bbf1902 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received unexpected event network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 for instance with vm_state building and task_state spawning.
Aug 09 01:17:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543830.303829, 1d85dc06-0278-4210-bf6d-52b07c3eb75e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] VM Resumed (Lifecycle Event)
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Instance spawned successfully.
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543830.306628, 1d85dc06-0278-4210-bf6d-52b07c3eb75e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] VM Started (Lifecycle Event)
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:17:10 user nova-compute[72780]: INFO nova.compute.manager [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Took 14.24 seconds to build instance.
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-ab67ef8b-edf4-4644-9a39-c89ddeffcb4e req-95033bbf-2adf-4ad3-9ca0-98de70ee0d51 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab67ef8b-edf4-4644-9a39-c89ddeffcb4e req-95033bbf-2adf-4ad3-9ca0-98de70ee0d51 service nova] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab67ef8b-edf4-4644-9a39-c89ddeffcb4e req-95033bbf-2adf-4ad3-9ca0-98de70ee0d51 service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-ab67ef8b-edf4-4644-9a39-c89ddeffcb4e req-95033bbf-2adf-4ad3-9ca0-98de70ee0d51 service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:17:10 user nova-compute[72780]: DEBUG nova.compute.manager [req-ab67ef8b-edf4-4644-9a39-c89ddeffcb4e req-95033bbf-2adf-4ad3-9ca0-98de70ee0d51 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] No waiting events found dispatching network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:17:10 user nova-compute[72780]: WARNING nova.compute.manager [req-ab67ef8b-edf4-4644-9a39-c89ddeffcb4e req-95033bbf-2adf-4ad3-9ca0-98de70ee0d51 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received unexpected event network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 for instance with vm_state active and task_state None.
Aug 09 01:17:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-1d453b97-acd9-46e8-b036-b5f07bd7277b tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.356s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:17:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:12 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543817.8708606, d278c2f7-4424-49f1-8750-c2f88d0096b8 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:17:12 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] VM Stopped (Lifecycle Event)
Aug 09 01:17:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-3100919f-3b26-4ea9-aceb-dd30835fdf9d None None] [instance: d278c2f7-4424-49f1-8750-c2f88d0096b8] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:17:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:17:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:32 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:17:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:40 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:17:42 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8110MB free_disk=25.085472106933594GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 79a235e2-a374-4955-99bd-06a707295550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1d85dc06-0278-4210-bf6d-52b07c3eb75e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:17:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:17:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Unshelving
Aug 09 01:17:48 user nova-compute[72780]: INFO nova.virt.block_device [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Booting with volume 14a421df-f77c-4c36-bed3-afa2a4ee7b86 at /dev/vdc
Aug 09 01:17:48 user nova-compute[72780]: DEBUG os_brick.utils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b9773-ab3e-47d2-a20d-2c584cb560d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f00bdb9-573c-4c57-b37c-20b77b5cae4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8580b4-cfde-41f4-af78-a8d3310c1a5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b45bb9f-44cc-418c-ac34-f6a27f941463]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:17:48 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:17:48 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3123eb6-5ffd-45ad-8d14-c454776a28ef]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG os_brick.utils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:17:48 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating existing volume attachment record: 77838e2a-0f5d-41a0-a574-fe92ac442cdc {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:17:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:17:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:17:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:17:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:17:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:18:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:18:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:04 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'pci_requests' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:04 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'numa_topology' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:04 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:18:04 user nova-compute[72780]: INFO nova.compute.claims [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Claim successful on node user
Aug 09 01:18:05 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:18:05 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:18:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:05 user nova-compute[72780]: INFO nova.network.neutron [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating port ee7b8575-9982-4075-a6f7-103f8f626ff3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.compute.manager [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.compute.manager [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing instance network info cache due to event network-changed-ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] Acquiring lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:18:06 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Creating image(s)
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'trusted_certs' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] Acquired lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG nova.network.neutron [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Refreshing network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "2cf68b69a3b75adfe955543c85412977c8d028b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "2cf68b69a3b75adfe955543c85412977c8d028b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.part --force-share --output=json" returned: 0 in 0.164s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:07 user nova-compute[72780]: DEBUG nova.virt.images [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] 6d57cee7-a584-44c9-a40d-319d812ebf9a was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 01:18:07 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:18:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.part /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG nova.network.neutron [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updated VIF entry in instance network info cache for port ee7b8575-9982-4075-a6f7-103f8f626ff3. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG nova.network.neutron [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0e616178-301f-44b3-b30e-a85b8c339806 req-c27b2b26-78b1-4997-9aa7-a1f4ea3565fe service nova] Releasing lock "refresh_cache-841d4941-6521-453f-82ed-784ea088187f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.part /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.converted" returned: 0 in 0.430s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "2cf68b69a3b75adfe955543c85412977c8d028b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.037s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "2cf68b69a3b75adfe955543c85412977c8d028b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "2cf68b69a3b75adfe955543c85412977c8d028b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9,backing_fmt=raw /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9,backing_fmt=raw /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk 1073741824" returned: 0 in 0.047s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "2cf68b69a3b75adfe955543c85412977c8d028b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:08 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'migration_context' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:09 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Rebasing disk image.
Aug 09 01:18:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 -F raw /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 -F raw /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk" returned: 0 in 2.197s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Ensure instance console log exists: /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Start _get_guest_xml network_info=[{"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='07193371960a5115b683f071745b03ca',container_format='bare',created_at=2023-08-09T01:15:56Z,direct_url=<?>,disk_format='qcow2',id=6d57cee7-a584-44c9-a40d-319d812ebf9a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1775000355-shelved',owner='9dd3451d1fb641ad8106f8b4bcb68fc1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T01:16:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkwvTCxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '841d4941-6521-453f-82ed-784ea088187f', 'attached_at': '', 'detached_at': '', 'volume_id': '14a421df-f77c-4c36-bed3-afa2a4ee7b86', 'serial': '14a421df-f77c-4c36-bed3-afa2a4ee7b86'}, 'disk_bus': 'virtio', 'attachment_id': '77838e2a-0f5d-41a0-a574-fe92ac442cdc', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:18:11 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:18:11 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='07193371960a5115b683f071745b03ca',container_format='bare',created_at=2023-08-09T01:15:56Z,direct_url=<?>,disk_format='qcow2',id=6d57cee7-a584-44c9-a40d-319d812ebf9a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1775000355-shelved',owner='9dd3451d1fb641ad8106f8b4bcb68fc1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T01:16:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'vcpu_model' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkwvTCxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:18:11 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:18:11 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:18:11 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb3d0d-1325-4690-bb3a-555078e433a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:18:11 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ee6f3d-4c2a-4085-a39e-fd0e44c974e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86] added
Aug 09 01:18:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[297437f3-d0ac-47a4-8674-63dbcf222a5f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4802d0fb-09bb-4694-9dcb-c496c9bcef7a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkwvTCxW {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkwvTCxW" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa287ff-4100-4c0a-accb-3d1cae259a2d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkwvTCxW'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ab048-d06c-4895-84f9-88ec3f76723e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad147890-ecb9-4986-a679-27da2cc0530b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2692cb0-c169-4664-87f7-bcb70fa2d773]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260]
Aug 09 01:18:11 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260] successful.
Aug 09 01:18:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb1649-fe1c-4adc-b563-07c3263407d8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2678a348-29a6-4e1c-8a5b-75dc576dae42]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:18:11 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df92be2-3bb9-44e3-99cf-4cc94fec6dff]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:11 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkwvTCxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23830376466646466', 'path': '/dev/sde'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830376466646466', 'path': '/dev/sde'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1775000355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1775000355',id=41,image_ref='6d57cee7-a584-44c9-a40d-319d812ebf9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1784194185',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-0nabra6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member',shelved_at='2023-08-09T01:16:00.173198',shelved_host='user',shelved_image_id='6d57cee7-a584-44c9-a40d-319d812ebf9a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=841d4941-6521-453f-82ed-784ea088187f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'pci_devices' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:18:12 user nova-compute[72780]:   <uuid>841d4941-6521-453f-82ed-784ea088187f</uuid>
Aug 09 01:18:12 user nova-compute[72780]:   <name>instance-00000029</name>
Aug 09 01:18:12 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:18:12 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:18:12 user nova-compute[72780]:   <metadata>
Aug 09 01:18:12 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:18:12 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:18:12 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1775000355</nova:name>
Aug 09 01:18:12 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:18:11</nova:creationTime>
Aug 09 01:18:12 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:18:12 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:18:12 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:18:12 user nova-compute[72780]:       <nova:owner>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:user uuid="0c7abd6cb25b47b58ccd80d9fda7ece0">tempest-AttachVolumeShelveTestJSON-1412186531-project-member</nova:user>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:project uuid="9dd3451d1fb641ad8106f8b4bcb68fc1">tempest-AttachVolumeShelveTestJSON-1412186531</nova:project>
Aug 09 01:18:12 user nova-compute[72780]:       </nova:owner>
Aug 09 01:18:12 user nova-compute[72780]:       <nova:root type="image" uuid="6d57cee7-a584-44c9-a40d-319d812ebf9a"/>
Aug 09 01:18:12 user nova-compute[72780]:       <nova:ports>
Aug 09 01:18:12 user nova-compute[72780]:         <nova:port uuid="ee7b8575-9982-4075-a6f7-103f8f626ff3">
Aug 09 01:18:12 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 01:18:12 user nova-compute[72780]:         </nova:port>
Aug 09 01:18:12 user nova-compute[72780]:       </nova:ports>
Aug 09 01:18:12 user nova-compute[72780]:     </nova:instance>
Aug 09 01:18:12 user nova-compute[72780]:   </metadata>
Aug 09 01:18:12 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:18:12 user nova-compute[72780]:     <system>
Aug 09 01:18:12 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:18:12 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:18:12 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:18:12 user nova-compute[72780]:       <entry name="serial">841d4941-6521-453f-82ed-784ea088187f</entry>
Aug 09 01:18:12 user nova-compute[72780]:       <entry name="uuid">841d4941-6521-453f-82ed-784ea088187f</entry>
Aug 09 01:18:12 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:18:12 user nova-compute[72780]:     </system>
Aug 09 01:18:12 user nova-compute[72780]:   </sysinfo>
Aug 09 01:18:12 user nova-compute[72780]:   <os>
Aug 09 01:18:12 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:18:12 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:18:12 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:18:12 user nova-compute[72780]:   </os>
Aug 09 01:18:12 user nova-compute[72780]:   <features>
Aug 09 01:18:12 user nova-compute[72780]:     <acpi/>
Aug 09 01:18:12 user nova-compute[72780]:     <apic/>
Aug 09 01:18:12 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:18:12 user nova-compute[72780]:   </features>
Aug 09 01:18:12 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:18:12 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:18:12 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:18:12 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:18:12 user nova-compute[72780]:   </clock>
Aug 09 01:18:12 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:18:12 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:18:12 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:18:12 user nova-compute[72780]:   </cpu>
Aug 09 01:18:12 user nova-compute[72780]:   <devices>
Aug 09 01:18:12 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:18:12 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:18:12 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk"/>
Aug 09 01:18:12 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:18:12 user nova-compute[72780]:     </disk>
Aug 09 01:18:12 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:18:12 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:18:12 user nova-compute[72780]:       <source dev="/dev/sde"/>
Aug 09 01:18:12 user nova-compute[72780]:       <target dev="vdc" bus="virtio"/>
Aug 09 01:18:12 user nova-compute[72780]:       <serial>14a421df-f77c-4c36-bed3-afa2a4ee7b86</serial>
Aug 09 01:18:12 user nova-compute[72780]:     </disk>
Aug 09 01:18:12 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:18:12 user nova-compute[72780]:       <mac address="fa:16:3e:e3:be:76"/>
Aug 09 01:18:12 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:18:12 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:18:12 user nova-compute[72780]:       <target dev="tapee7b8575-99"/>
Aug 09 01:18:12 user nova-compute[72780]:     </interface>
Aug 09 01:18:12 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:18:12 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/console.log" append="off"/>
Aug 09 01:18:12 user nova-compute[72780]:     </serial>
Aug 09 01:18:12 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:18:12 user nova-compute[72780]:     <video>
Aug 09 01:18:12 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:18:12 user nova-compute[72780]:     </video>
Aug 09 01:18:12 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:18:12 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:18:12 user nova-compute[72780]:     </rng>
Aug 09 01:18:12 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:18:12 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:18:12 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:18:12 user nova-compute[72780]:     </memballoon>
Aug 09 01:18:12 user nova-compute[72780]:   </devices>
Aug 09 01:18:12 user nova-compute[72780]: </domain>
Aug 09 01:18:12 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1775000355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1775000355',id=41,image_ref='6d57cee7-a584-44c9-a40d-319d812ebf9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1784194185',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-0nabra6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member',shelved_at='2023-08-09T01:16:00.173198',shelved_host='user',shelved_image_id='6d57cee7-a584-44c9-a40d-319d812ebf9a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=841d4941-6521-453f-82ed-784ea088187f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG os_vif [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee7b8575-99, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee7b8575-99, col_values=(('external_ids', {'iface-id': 'ee7b8575-9982-4075-a6f7-103f8f626ff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:be:76', 'vm-uuid': '841d4941-6521-453f-82ed-784ea088187f'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:12 user nova-compute[72780]: INFO os_vif [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99')
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:18:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No VIF found with MAC fa:16:3e:e3:be:76, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-7fc090e4-6298-4993-8cfe-0bb8bbffaaf7 req-89218d36-3bce-42fd-b9c7-321d741989d0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7fc090e4-6298-4993-8cfe-0bb8bbffaaf7 req-89218d36-3bce-42fd-b9c7-321d741989d0 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7fc090e4-6298-4993-8cfe-0bb8bbffaaf7 req-89218d36-3bce-42fd-b9c7-321d741989d0 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7fc090e4-6298-4993-8cfe-0bb8bbffaaf7 req-89218d36-3bce-42fd-b9c7-321d741989d0 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-7fc090e4-6298-4993-8cfe-0bb8bbffaaf7 req-89218d36-3bce-42fd-b9c7-321d741989d0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:14 user nova-compute[72780]: WARNING nova.compute.manager [req-7fc090e4-6298-4993-8cfe-0bb8bbffaaf7 req-89218d36-3bce-42fd-b9c7-321d741989d0 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543896.3400426, 841d4941-6521-453f-82ed-784ea088187f => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:18:16 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] VM Resumed (Lifecycle Event)
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:18:16 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance spawned successfully.
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:18:16 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543896.3425303, 841d4941-6521-453f-82ed-784ea088187f => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:18:16 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] VM Started (Lifecycle Event)
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:18:16 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:18:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-20193d7e-6196-4b50-b18f-f2bbd4f76323 req-e96c8e53-6bf6-4c5f-8c85-b08f82586f86 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-20193d7e-6196-4b50-b18f-f2bbd4f76323 req-e96c8e53-6bf6-4c5f-8c85-b08f82586f86 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-20193d7e-6196-4b50-b18f-f2bbd4f76323 req-e96c8e53-6bf6-4c5f-8c85-b08f82586f86 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-20193d7e-6196-4b50-b18f-f2bbd4f76323 req-e96c8e53-6bf6-4c5f-8c85-b08f82586f86 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-20193d7e-6196-4b50-b18f-f2bbd4f76323 req-e96c8e53-6bf6-4c5f-8c85-b08f82586f86 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:16 user nova-compute[72780]: WARNING nova.compute.manager [req-20193d7e-6196-4b50-b18f-f2bbd4f76323 req-e96c8e53-6bf6-4c5f-8c85-b08f82586f86 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 01:18:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6433bff4-4a62-4f77-aa5c-65d75d4084eb tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.451s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:18:19 user nova-compute[72780]: INFO nova.compute.claims [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Claim successful on node user
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:18:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.policy [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9ec6e6c8ce14879a1397fec6429c4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16197c0497354e32b5ead73377548f30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:18:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Creating image(s)
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "/opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "/opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "/opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk 1073741824" returned: 0 in 0.073s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Cannot resize image /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'migration_context' on Instance uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Successfully created port: 996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Ensure instance console log exists: /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Successfully updated port: 996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquired lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-changed-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Refreshing instance network info cache due to event network-changed-996a6df7-d956-48a0-920a-7b5173c4f13d. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] Acquiring lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updating instance_info_cache with network_info: [{"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Releasing lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Instance network_info: |[{"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] Acquired lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.neutron [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Refreshing network info cache for port 996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Start _get_guest_xml network_info=[{"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:18:21 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:18:21 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1100154912',display_name='tempest-VolumesSnapshotTestJSON-instance-1100154912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1100154912',id=46,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6O7AQhMuZfmNsA0tI/j7M//XVwLAufXDY/d6PC7bb50vIoUfdJyoSFD4VqXtBhY80KBIkvarbS+0t0puXldOzc168iVlkfTzDGB+DWxPUzAQpW/gaAKbKpbWOZi8QxGg==',key_name='tempest-keypair-1803731076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16197c0497354e32b5ead73377548f30',ramdisk_id='',reservation_id='r-j12x4ar9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-468237489',owner_user_name='tempest-VolumesSnapshotTestJSON-468237489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ec6e6c8ce14879a1397fec6429c4d1',uuid=61574b0b-f8f7-42ae-8580-082b2deaf310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converting VIF {"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'pci_devices' on Instance uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:18:21 user nova-compute[72780]:   <uuid>61574b0b-f8f7-42ae-8580-082b2deaf310</uuid>
Aug 09 01:18:21 user nova-compute[72780]:   <name>instance-0000002e</name>
Aug 09 01:18:21 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:18:21 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:18:21 user nova-compute[72780]:   <metadata>
Aug 09 01:18:21 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:18:21 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:18:21 user nova-compute[72780]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1100154912</nova:name>
Aug 09 01:18:21 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:18:21</nova:creationTime>
Aug 09 01:18:21 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:18:21 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:18:21 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:18:21 user nova-compute[72780]:       <nova:owner>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:user uuid="f9ec6e6c8ce14879a1397fec6429c4d1">tempest-VolumesSnapshotTestJSON-468237489-project-member</nova:user>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:project uuid="16197c0497354e32b5ead73377548f30">tempest-VolumesSnapshotTestJSON-468237489</nova:project>
Aug 09 01:18:21 user nova-compute[72780]:       </nova:owner>
Aug 09 01:18:21 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:18:21 user nova-compute[72780]:       <nova:ports>
Aug 09 01:18:21 user nova-compute[72780]:         <nova:port uuid="996a6df7-d956-48a0-920a-7b5173c4f13d">
Aug 09 01:18:21 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:18:21 user nova-compute[72780]:         </nova:port>
Aug 09 01:18:21 user nova-compute[72780]:       </nova:ports>
Aug 09 01:18:21 user nova-compute[72780]:     </nova:instance>
Aug 09 01:18:21 user nova-compute[72780]:   </metadata>
Aug 09 01:18:21 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:18:21 user nova-compute[72780]:     <system>
Aug 09 01:18:21 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:18:21 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:18:21 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:18:21 user nova-compute[72780]:       <entry name="serial">61574b0b-f8f7-42ae-8580-082b2deaf310</entry>
Aug 09 01:18:21 user nova-compute[72780]:       <entry name="uuid">61574b0b-f8f7-42ae-8580-082b2deaf310</entry>
Aug 09 01:18:21 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:18:21 user nova-compute[72780]:     </system>
Aug 09 01:18:21 user nova-compute[72780]:   </sysinfo>
Aug 09 01:18:21 user nova-compute[72780]:   <os>
Aug 09 01:18:21 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:18:21 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:18:21 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:18:21 user nova-compute[72780]:   </os>
Aug 09 01:18:21 user nova-compute[72780]:   <features>
Aug 09 01:18:21 user nova-compute[72780]:     <acpi/>
Aug 09 01:18:21 user nova-compute[72780]:     <apic/>
Aug 09 01:18:21 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:18:21 user nova-compute[72780]:   </features>
Aug 09 01:18:21 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:18:21 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:18:21 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:18:21 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:18:21 user nova-compute[72780]:   </clock>
Aug 09 01:18:21 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:18:21 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:18:21 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:18:21 user nova-compute[72780]:   </cpu>
Aug 09 01:18:21 user nova-compute[72780]:   <devices>
Aug 09 01:18:21 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:18:21 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:18:21 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk"/>
Aug 09 01:18:21 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:18:21 user nova-compute[72780]:     </disk>
Aug 09 01:18:21 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:18:21 user nova-compute[72780]:       <mac address="fa:16:3e:16:62:2d"/>
Aug 09 01:18:21 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:18:21 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:18:21 user nova-compute[72780]:       <target dev="tap996a6df7-d9"/>
Aug 09 01:18:21 user nova-compute[72780]:     </interface>
Aug 09 01:18:21 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:18:21 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/console.log" append="off"/>
Aug 09 01:18:21 user nova-compute[72780]:     </serial>
Aug 09 01:18:21 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:18:21 user nova-compute[72780]:     <video>
Aug 09 01:18:21 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:18:21 user nova-compute[72780]:     </video>
Aug 09 01:18:21 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:18:21 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:18:21 user nova-compute[72780]:     </rng>
Aug 09 01:18:21 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:18:21 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:18:21 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:18:21 user nova-compute[72780]:     </memballoon>
Aug 09 01:18:21 user nova-compute[72780]:   </devices>
Aug 09 01:18:21 user nova-compute[72780]: </domain>
Aug 09 01:18:21 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1100154912',display_name='tempest-VolumesSnapshotTestJSON-instance-1100154912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1100154912',id=46,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6O7AQhMuZfmNsA0tI/j7M//XVwLAufXDY/d6PC7bb50vIoUfdJyoSFD4VqXtBhY80KBIkvarbS+0t0puXldOzc168iVlkfTzDGB+DWxPUzAQpW/gaAKbKpbWOZi8QxGg==',key_name='tempest-keypair-1803731076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16197c0497354e32b5ead73377548f30',ramdisk_id='',reservation_id='r-j12x4ar9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-468237489',owner_user_name='tempest-VolumesSnapshotTestJSON-468237489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ec6e6c8ce14879a1397fec6429c4d1',uuid=61574b0b-f8f7-42ae-8580-082b2deaf310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converting VIF {"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG os_vif [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap996a6df7-d9, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap996a6df7-d9, col_values=(('external_ids', {'iface-id': '996a6df7-d956-48a0-920a-7b5173c4f13d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:62:2d', 'vm-uuid': '61574b0b-f8f7-42ae-8580-082b2deaf310'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:18:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:22 user nova-compute[72780]: INFO os_vif [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9')
Aug 09 01:18:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:18:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No VIF found with MAC fa:16:3e:16:62:2d, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:18:22 user nova-compute[72780]: DEBUG nova.network.neutron [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updated VIF entry in instance network info cache for port 996a6df7-d956-48a0-920a-7b5173c4f13d. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:18:22 user nova-compute[72780]: DEBUG nova.network.neutron [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updating instance_info_cache with network_info: [{"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-516b989c-2275-45bd-9b35-4aecf522ec33 req-0fdc5eac-79b1-4949-8931-46c300c1608c service nova] Releasing lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-f6225db2-b092-46c2-a434-d0aa8114c79c req-2e42ba43-ffe8-4a8d-b778-ef23debbda41 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6225db2-b092-46c2-a434-d0aa8114c79c req-2e42ba43-ffe8-4a8d-b778-ef23debbda41 service nova] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6225db2-b092-46c2-a434-d0aa8114c79c req-2e42ba43-ffe8-4a8d-b778-ef23debbda41 service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f6225db2-b092-46c2-a434-d0aa8114c79c req-2e42ba43-ffe8-4a8d-b778-ef23debbda41 service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-f6225db2-b092-46c2-a434-d0aa8114c79c req-2e42ba43-ffe8-4a8d-b778-ef23debbda41 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] No waiting events found dispatching network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:23 user nova-compute[72780]: WARNING nova.compute.manager [req-f6225db2-b092-46c2-a434-d0aa8114c79c req-2e42ba43-ffe8-4a8d-b778-ef23debbda41 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received unexpected event network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d for instance with vm_state building and task_state spawning.
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543905.39284, 61574b0b-f8f7-42ae-8580-082b2deaf310 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] VM Resumed (Lifecycle Event)
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Instance spawned successfully.
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543905.3939164, 61574b0b-f8f7-42ae-8580-082b2deaf310 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] VM Started (Lifecycle Event)
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:25 user nova-compute[72780]: INFO nova.compute.manager [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Took 6.33 seconds to build instance.
Aug 09 01:18:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d483e135-7181-48d1-9072-87b6cd963a99 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.434s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-664c1771-b601-481a-89d3-3c7d446a16ab req-114c8a48-84c2-4a1f-85a3-ac1325f043f3 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-664c1771-b601-481a-89d3-3c7d446a16ab req-114c8a48-84c2-4a1f-85a3-ac1325f043f3 service nova] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-664c1771-b601-481a-89d3-3c7d446a16ab req-114c8a48-84c2-4a1f-85a3-ac1325f043f3 service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-664c1771-b601-481a-89d3-3c7d446a16ab req-114c8a48-84c2-4a1f-85a3-ac1325f043f3 service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-664c1771-b601-481a-89d3-3c7d446a16ab req-114c8a48-84c2-4a1f-85a3-ac1325f043f3 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] No waiting events found dispatching network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:25 user nova-compute[72780]: WARNING nova.compute.manager [req-664c1771-b601-481a-89d3-3c7d446a16ab req-114c8a48-84c2-4a1f-85a3-ac1325f043f3 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received unexpected event network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d for instance with vm_state active and task_state None.
Aug 09 01:18:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 1d85dc06-0278-4210-bf6d-52b07c3eb75e {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "841d4941-6521-453f-82ed-784ea088187f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "841d4941-6521-453f-82ed-784ea088187f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing instance network info cache due to event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updated VIF entry in instance network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG nova.network.neutron [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8d6a7cce-a9b9-4210-9c3d-223b1cc7dbce req-533107bf-513e-4b37-816f-e1dd058dc2ff service nova] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing instance network info cache due to event network-changed-c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] Acquiring lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] Acquired lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Refreshing network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:31 user nova-compute[72780]: INFO nova.compute.manager [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Detaching volume 8a4033db-70ed-4382-a529-9c2723051db7
Aug 09 01:18:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:31 user nova-compute[72780]: INFO nova.virt.block_device [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Attempting to driver detach volume 8a4033db-70ed-4382-a529-9c2723051db7 from mountpoint /dev/vdb
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Attempting to detach device vdb from instance 79a235e2-a374-4955-99bd-06a707295550 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:18:31 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:18:31 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 01:18:31 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:18:31 user nova-compute[72780]:   <serial>8a4033db-70ed-4382-a529-9c2723051db7</serial>
Aug 09 01:18:31 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 01:18:31 user nova-compute[72780]: </disk>
Aug 09 01:18:31 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:18:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully detached device vdb from instance 79a235e2-a374-4955-99bd-06a707295550 from the persistent domain config.
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79a235e2-a374-4955-99bd-06a707295550 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:18:31 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:18:31 user nova-compute[72780]:   <source dev="/dev/sdd"/>
Aug 09 01:18:31 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:18:31 user nova-compute[72780]:   <serial>8a4033db-70ed-4382-a529-9c2723051db7</serial>
Aug 09 01:18:31 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 01:18:31 user nova-compute[72780]: </disk>
Aug 09 01:18:31 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updated VIF entry in instance network info cache for port c7e45dad-4206-4406-ab14-ad04ba3a283f. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [{"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b84debe8-c10f-4e47-8b2f-1374ac5e548b req-196ff35f-7159-4418-9447-0db2b75d16c7 service nova] Releasing lock "refresh_cache-79a235e2-a374-4955-99bd-06a707295550" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543911.9765742, 79a235e2-a374-4955-99bd-06a707295550 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:18:31 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully detached device vdb from instance 79a235e2-a374-4955-99bd-06a707295550 from the live domain config.
Aug 09 01:18:31 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJBNlvaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:18:31 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:18:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5985788-cefa-4658-ab53-0d8149cd4b17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930fd57-a2cd-488c-b215-0f8f7959c9f0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:32 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:18:32 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:32 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:18:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:32 user nova-compute[72780]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 (non-flash)
Aug 09 01:18:32 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:32 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:18:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa0507d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7'): ({'sdd'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Removing single pathed devices sdd {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d7fd40-ec72-46ad-88ab-a32fda69aa37]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f8a3b-48c0-496c-ae1e-a452b7abe4ec]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flushing IO for device /dev/sdd {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acbb179-0f7d-4d8d-a442-31a3b07f20c1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.082s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[74538c90-fdda-475e-ad2c-1de2e89759e9]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] SCSI volumes sdd have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[621c5feb-9d0d-4ada-8a09-d6a44ac12fb9]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[88abd900-621e-40da-8520-ee21b4fd6c28]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260]
Aug 09 01:18:32 user nova-compute[72780]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7, portal: 172.16.0.220,3260] successful.
Aug 09 01:18:32 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a4033db-70ed-4382-a529-9c2723051db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf757e38-10e7-49bc-8ba8-d57fdff07668]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== disconnect_volume: return (334ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:18:32 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:18:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'flavor' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-55806bb1-6380-4700-bc2b-00def8e85e6d tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:18:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:18:44 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:18:44 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=7897MB free_disk=25.023086547851562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 79a235e2-a374-4955-99bd-06a707295550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 1d85dc06-0278-4210-bf6d-52b07c3eb75e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 841d4941-6521-453f-82ed-784ea088187f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61574b0b-f8f7-42ae-8580-082b2deaf310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:18:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:45 user nova-compute[72780]: INFO nova.compute.manager [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Unrescuing
Aug 09 01:18:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:18:45 user nova-compute[72780]: DEBUG nova.network.neutron [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'flavor' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-6c16972d-b5c4-4215-a8ee-0e748c18a4fa req-e51ce889-6bbc-4479-8da6-bbe0617a8e45 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c16972d-b5c4-4215-a8ee-0e748c18a4fa req-e51ce889-6bbc-4479-8da6-bbe0617a8e45 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c16972d-b5c4-4215-a8ee-0e748c18a4fa req-e51ce889-6bbc-4479-8da6-bbe0617a8e45 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6c16972d-b5c4-4215-a8ee-0e748c18a4fa req-e51ce889-6bbc-4479-8da6-bbe0617a8e45 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-6c16972d-b5c4-4215-a8ee-0e748c18a4fa req-e51ce889-6bbc-4479-8da6-bbe0617a8e45 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:46 user nova-compute[72780]: WARNING nova.compute.manager [req-6c16972d-b5c4-4215-a8ee-0e748c18a4fa req-e51ce889-6bbc-4479-8da6-bbe0617a8e45 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:18:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:46 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance destroyed successfully.
Aug 09 01:18:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:48 user nova-compute[72780]: WARNING nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-changed-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Refreshing instance network info cache due to event network-changed-d4196123-ed0c-4907-90f7-c5d4253e9361. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Acquiring lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Acquired lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Refreshing network info cache for port d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updated VIF entry in instance network info cache for port d4196123-ed0c-4907-90f7-c5d4253e9361. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.network.neutron [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updating instance_info_cache with network_info: [{"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Releasing lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:48 user nova-compute[72780]: DEBUG nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:48 user nova-compute[72780]: WARNING nova.compute.manager [req-f18a6f2e-bcaf-4ea3-a9c9-4c3546c9bf91 req-3f078f98-c5ca-4d37-bd86-6c6f1df5b415 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:49 user nova-compute[72780]: INFO nova.compute.manager [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Terminating instance
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d88d921a-2b39-45cd-98e4-42f4f33afa68 req-f46cd66e-d61f-47b1-bc84-06032051350f service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-vif-unplugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d88d921a-2b39-45cd-98e4-42f4f33afa68 req-f46cd66e-d61f-47b1-bc84-06032051350f service nova] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d88d921a-2b39-45cd-98e4-42f4f33afa68 req-f46cd66e-d61f-47b1-bc84-06032051350f service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d88d921a-2b39-45cd-98e4-42f4f33afa68 req-f46cd66e-d61f-47b1-bc84-06032051350f service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d88d921a-2b39-45cd-98e4-42f4f33afa68 req-f46cd66e-d61f-47b1-bc84-06032051350f service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] No waiting events found dispatching network-vif-unplugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-d88d921a-2b39-45cd-98e4-42f4f33afa68 req-f46cd66e-d61f-47b1-bc84-06032051350f service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-vif-unplugged-d4196123-ed0c-4907-90f7-c5d4253e9361 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:18:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Instance destroyed successfully.
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.objects.instance [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'resources' on Instance uuid 1d85dc06-0278-4210-bf6d-52b07c3eb75e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-944096451',display_name='tempest-TestVolumeBootPattern-server-944096451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-944096451',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-ff8j2n66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:17:10Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=1d85dc06-0278-4210-bf6d-52b07c3eb75e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG os_vif [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4196123-ed, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:49 user nova-compute[72780]: INFO os_vif [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:db:f0,bridge_name='br-int',has_traffic_filtering=True,id=d4196123-ed0c-4907-90f7-c5d4253e9361,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4196123-ed')
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdFwpGeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:18:50 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9111d543-c34c-4fa9-803e-457c66dc6df3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eecc00-3e99-48a9-916a-1633a336d0ef]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:50 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:50 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:18:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:18:50 user nova-compute[72780]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 (non-flash)
Aug 09 01:18:50 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:18:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06d8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[27451e45-6f2c-4e3e-9794-16fdb64b8fa9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffdf632-6d0c-4113-a4a2-450e21a61798]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2e2a9-307e-4aa5-94f5-cf09dfa38ae0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[edad3f4f-74ed-4ca4-9e40-5ffd634ed4da]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23531636534356637', '/dev/disk/by-id/scsi-1SCST_BIO1e140b7a-51ce45f7450e009f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e140b7a') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192ce5f-0485-4a25-83e0-a707e4f300c8]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2ccdff-c17c-433e-9e10-437aa13b259d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for f2b9c8e3-3ca7-452d-a586-11130fa4442a due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543930.2473826, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:18:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Resumed (Lifecycle Event)
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b5fcc4b9-fabe-474c-84fa-42f1d4eba9bb tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a9552-fba5-4527-a693-d4766db30745]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260]
Aug 09 01:18:50 user nova-compute[72780]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993, portal: 172.16.0.220,3260] successful.
Aug 09 01:18:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:18:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691543930.2498598, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:18:50 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Started (Lifecycle Event)
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c852af-b86c-4c5f-8ea3-7ca841ba4993 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[863da991-99e6-402d-be3e-137a307e537b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:50 user nova-compute[72780]: WARNING nova.compute.manager [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state active and task_state None.
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-changed-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Refreshing instance network info cache due to event network-changed-d4196123-ed0c-4907-90f7-c5d4253e9361. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] Acquiring lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] Acquired lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.network.neutron [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Refreshing network info cache for port d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.674s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== disconnect_volume: return (676ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:18:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Deleting instance files /opt/stack/data/nova/instances/1d85dc06-0278-4210-bf6d-52b07c3eb75e_del
Aug 09 01:18:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Deletion of /opt/stack/data/nova/instances/1d85dc06-0278-4210-bf6d-52b07c3eb75e_del complete
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:18:50 user nova-compute[72780]: INFO nova.compute.manager [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Took 1.60 seconds to destroy the instance on the hypervisor.
Aug 09 01:18:50 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:18:50 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG nova.network.neutron [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updated VIF entry in instance network info cache for port d4196123-ed0c-4907-90f7-c5d4253e9361. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG nova.network.neutron [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updating instance_info_cache with network_info: [{"id": "d4196123-ed0c-4907-90f7-c5d4253e9361", "address": "fa:16:3e:25:db:f0", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4196123-ed", "ovs_interfaceid": "d4196123-ed0c-4907-90f7-c5d4253e9361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-94c40c8d-eb06-4d72-869c-ab786702cc40 req-9bc0249d-45d7-47ef-b8df-22a4b222f9e0 service nova] Releasing lock "refresh_cache-1d85dc06-0278-4210-bf6d-52b07c3eb75e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:18:51 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Took 0.56 seconds to deallocate network for instance.
Aug 09 01:18:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-89d47981-83e9-484f-aa15-b075bbbbab05 req-960c222b-b1be-4a64-b830-2d763c0bbfe5 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-89d47981-83e9-484f-aa15-b075bbbbab05 req-960c222b-b1be-4a64-b830-2d763c0bbfe5 service nova] Acquiring lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-89d47981-83e9-484f-aa15-b075bbbbab05 req-960c222b-b1be-4a64-b830-2d763c0bbfe5 service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-89d47981-83e9-484f-aa15-b075bbbbab05 req-960c222b-b1be-4a64-b830-2d763c0bbfe5 service nova] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-89d47981-83e9-484f-aa15-b075bbbbab05 req-960c222b-b1be-4a64-b830-2d763c0bbfe5 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] No waiting events found dispatching network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:18:51 user nova-compute[72780]: WARNING nova.compute.manager [req-89d47981-83e9-484f-aa15-b075bbbbab05 req-960c222b-b1be-4a64-b830-2d763c0bbfe5 service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received unexpected event network-vif-plugged-d4196123-ed0c-4907-90f7-c5d4253e9361 for instance with vm_state active and task_state deleting.
Aug 09 01:18:52 user nova-compute[72780]: INFO nova.compute.manager [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Took 0.76 seconds to detach 1 volumes for instance.
Aug 09 01:18:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:18:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:18:52 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:18:52 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:18:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:52 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Deleted allocations for instance 1d85dc06-0278-4210-bf6d-52b07c3eb75e
Aug 09 01:18:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-617a0a8c-6621-4f1d-9a3a-fc8c0b35ec00 req-9a70bd4e-cebe-4b77-935a-0324fc5be2ff service nova] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Received event network-vif-deleted-d4196123-ed0c-4907-90f7-c5d4253e9361 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:18:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-66da91d2-6a23-4dde-8c8e-e9ed355f53b2 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "1d85dc06-0278-4210-bf6d-52b07c3eb75e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.363s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:18:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:18:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:04 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543929.9597547, 1d85dc06-0278-4210-bf6d-52b07c3eb75e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:19:04 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] VM Stopped (Lifecycle Event)
Aug 09 01:19:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-18123d1b-8d2c-499b-9922-cb738fc8dc9b None None] [instance: 1d85dc06-0278-4210-bf6d-52b07c3eb75e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:19:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:19:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:19:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:19:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:19:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:19:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:25 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:27 user nova-compute[72780]: INFO nova.compute.manager [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Terminating instance
Aug 09 01:19:27 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Instance destroyed successfully.
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'resources' on Instance uuid 79a235e2-a374-4955-99bd-06a707295550 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1328901129',display_name='tempest-TestMinimumBasicScenario-server-1328901129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1328901129',id=43,image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQTBb/f0tA7RQKiwVDK0Cqi8MzqeBz9KyvQg7X24229/5QBhHm4pVIDmfAxDXVl4OIu2jselLP0ZuXkiTiHKOjvUD+mTjCWHN/5Eq6e6/xD1rxlOc7fa74jFOX0jAQ11w==',key_name='tempest-TestMinimumBasicScenario-2041241445',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-m07gdzw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='762e0ae3-efa6-446e-900b-b85908e10dca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:16:47Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=79a235e2-a374-4955-99bd-06a707295550,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "address": "fa:16:3e:50:af:42", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e45dad-42", "ovs_interfaceid": "c7e45dad-4206-4406-ab14-ad04ba3a283f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG os_vif [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7e45dad-42, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-d5d2cc80-c180-4041-ad64-198f836e8457 req-e7ea9cff-e232-42c7-8ad5-ca20954b5e92 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-unplugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d5d2cc80-c180-4041-ad64-198f836e8457 req-e7ea9cff-e232-42c7-8ad5-ca20954b5e92 service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d5d2cc80-c180-4041-ad64-198f836e8457 req-e7ea9cff-e232-42c7-8ad5-ca20954b5e92 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d5d2cc80-c180-4041-ad64-198f836e8457 req-e7ea9cff-e232-42c7-8ad5-ca20954b5e92 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-d5d2cc80-c180-4041-ad64-198f836e8457 req-e7ea9cff-e232-42c7-8ad5-ca20954b5e92 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-unplugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-d5d2cc80-c180-4041-ad64-198f836e8457 req-e7ea9cff-e232-42c7-8ad5-ca20954b5e92 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-unplugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:19:28 user nova-compute[72780]: INFO os_vif [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:af:42,bridge_name='br-int',has_traffic_filtering=True,id=c7e45dad-4206-4406-ab14-ad04ba3a283f,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e45dad-42')
Aug 09 01:19:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Deleting instance files /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550_del
Aug 09 01:19:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Deletion of /opt/stack/data/nova/instances/79a235e2-a374-4955-99bd-06a707295550_del complete
Aug 09 01:19:28 user nova-compute[72780]: INFO nova.compute.manager [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: 79a235e2-a374-4955-99bd-06a707295550] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 01:19:28 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:19:28 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] Took 0.65 seconds to deallocate network for instance.
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-870294bb-de16-4667-b700-b81d4280c67c req-8a6de159-7915-45e5-bcc4-6f51e30601b3 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-deleted-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:28 user nova-compute[72780]: INFO nova.compute.manager [req-870294bb-de16-4667-b700-b81d4280c67c req-8a6de159-7915-45e5-bcc4-6f51e30601b3 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Neutron deleted interface c7e45dad-4206-4406-ab14-ad04ba3a283f; detaching it from the instance and deleting it from the info cache
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.network.neutron [req-870294bb-de16-4667-b700-b81d4280c67c req-8a6de159-7915-45e5-bcc4-6f51e30601b3 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-870294bb-de16-4667-b700-b81d4280c67c req-8a6de159-7915-45e5-bcc4-6f51e30601b3 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Detach interface failed, port_id=c7e45dad-4206-4406-ab14-ad04ba3a283f, reason: Instance 79a235e2-a374-4955-99bd-06a707295550 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:19:29 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:19:29 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Deleted allocations for instance 79a235e2-a374-4955-99bd-06a707295550
Aug 09 01:19:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a12d9074-9954-4a7f-aefa-b07f0f17d44a tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "79a235e2-a374-4955-99bd-06a707295550" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating instance_info_cache with network_info: [{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-1685e279-ece7-4d9c-97d5-d99ed81cb0cf req-f8deb944-247b-467a-a195-beb87a3a7267 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1685e279-ece7-4d9c-97d5-d99ed81cb0cf req-f8deb944-247b-467a-a195-beb87a3a7267 service nova] Acquiring lock "79a235e2-a374-4955-99bd-06a707295550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1685e279-ece7-4d9c-97d5-d99ed81cb0cf req-f8deb944-247b-467a-a195-beb87a3a7267 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1685e279-ece7-4d9c-97d5-d99ed81cb0cf req-f8deb944-247b-467a-a195-beb87a3a7267 service nova] Lock "79a235e2-a374-4955-99bd-06a707295550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-1685e279-ece7-4d9c-97d5-d99ed81cb0cf req-f8deb944-247b-467a-a195-beb87a3a7267 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] No waiting events found dispatching network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:19:30 user nova-compute[72780]: WARNING nova.compute.manager [req-1685e279-ece7-4d9c-97d5-d99ed81cb0cf req-f8deb944-247b-467a-a195-beb87a3a7267 service nova] [instance: 79a235e2-a374-4955-99bd-06a707295550] Received unexpected event network-vif-plugged-c7e45dad-4206-4406-ab14-ad04ba3a283f for instance with vm_state deleted and task_state None.
Aug 09 01:19:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:19:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:38 user nova-compute[72780]: INFO nova.compute.manager [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Detaching volume 14a421df-f77c-4c36-bed3-afa2a4ee7b86
Aug 09 01:19:38 user nova-compute[72780]: INFO nova.virt.block_device [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Attempting to driver detach volume 14a421df-f77c-4c36-bed3-afa2a4ee7b86 from mountpoint /dev/vdc
Aug 09 01:19:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Attempting to detach device vdc from instance 841d4941-6521-453f-82ed-784ea088187f from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:19:38 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:19:38 user nova-compute[72780]:   <source dev="/dev/sde"/>
Aug 09 01:19:38 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:19:38 user nova-compute[72780]:   <serial>14a421df-f77c-4c36-bed3-afa2a4ee7b86</serial>
Aug 09 01:19:38 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 01:19:38 user nova-compute[72780]: </disk>
Aug 09 01:19:38 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:19:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully detached device vdc from instance 841d4941-6521-453f-82ed-784ea088187f from the persistent domain config.
Aug 09 01:19:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 841d4941-6521-453f-82ed-784ea088187f from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:19:38 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:19:38 user nova-compute[72780]:   <source dev="/dev/sde"/>
Aug 09 01:19:38 user nova-compute[72780]:   <target dev="vdc" bus="virtio"/>
Aug 09 01:19:38 user nova-compute[72780]:   <serial>14a421df-f77c-4c36-bed3-afa2a4ee7b86</serial>
Aug 09 01:19:38 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 01:19:38 user nova-compute[72780]: </disk>
Aug 09 01:19:38 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:19:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691543978.9986649, 841d4941-6521-453f-82ed-784ea088187f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:19:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully detached device vdc from instance 841d4941-6521-453f-82ed-784ea088187f from the live domain config.
Aug 09 01:19:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkwvTCxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:19:39 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[211dbd5a-3323-42d4-9245-00cc61d316cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c66827-34ec-44f7-8ff4-ed4665268a7a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:19:39 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:19:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:19:39 user nova-compute[72780]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 (non-flash)
Aug 09 01:19:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06856c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86'): ({'sde'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Removing single pathed devices sde {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef25e68-9f15-40b7-8267-f5ae5fcf4b12]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e546a-412e-4be2-bf48-fbf074972449]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flushing IO for device /dev/sde {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da7cbc-3cec-4654-b146-2612b8660feb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7dea52-cd47-433f-b332-6d403ff286c5]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] SCSI volumes sde have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5efcbd-b378-41b7-a7a4-1a71fad2d220]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac0639f-e64a-4985-8bdd-a681468455ba]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260]
Aug 09 01:19:39 user nova-compute[72780]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86, portal: 172.16.0.220,3260] successful.
Aug 09 01:19:39 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14a421df-f77c-4c36-bed3-afa2a4ee7b86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0d57f2-0ba3-4eb8-b045-c3bc8be675a2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] <== disconnect_volume: return (260ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:19:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'flavor' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:19:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a95b13e3-e340-4702-ae2b-4112dfdde4e3 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.583s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:43 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543968.0633185, 79a235e2-a374-4955-99bd-06a707295550 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:19:43 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 79a235e2-a374-4955-99bd-06a707295550] VM Stopped (Lifecycle Event)
Aug 09 01:19:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-f4f9db57-d044-452b-a90f-31265edd33ee None None] [instance: 79a235e2-a374-4955-99bd-06a707295550] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:19:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:19:46 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:19:46 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=25.047367095947266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 841d4941-6521-453f-82ed-784ea088187f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61574b0b-f8f7-42ae-8580-082b2deaf310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:19:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-changed-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Refreshing instance network info cache due to event network-changed-6df50ef7-e282-4d9c-aa2d-7a372a0c2022. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] Acquiring lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] Acquired lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG nova.network.neutron [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Refreshing network info cache for port 6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:49 user nova-compute[72780]: INFO nova.compute.manager [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Terminating instance
Aug 09 01:19:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:19:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-3632d721-c2c5-4ecf-abfd-c9b8e739d4c5 req-c3d64dfc-80e3-4915-94b5-a2f241bab8f9 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-vif-unplugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3632d721-c2c5-4ecf-abfd-c9b8e739d4c5 req-c3d64dfc-80e3-4915-94b5-a2f241bab8f9 service nova] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3632d721-c2c5-4ecf-abfd-c9b8e739d4c5 req-c3d64dfc-80e3-4915-94b5-a2f241bab8f9 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3632d721-c2c5-4ecf-abfd-c9b8e739d4c5 req-c3d64dfc-80e3-4915-94b5-a2f241bab8f9 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-3632d721-c2c5-4ecf-abfd-c9b8e739d4c5 req-c3d64dfc-80e3-4915-94b5-a2f241bab8f9 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] No waiting events found dispatching network-vif-unplugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.compute.manager [req-3632d721-c2c5-4ecf-abfd-c9b8e739d4c5 req-c3d64dfc-80e3-4915-94b5-a2f241bab8f9 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-vif-unplugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.network.neutron [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updated VIF entry in instance network info cache for port 6df50ef7-e282-4d9c-aa2d-7a372a0c2022. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.network.neutron [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating instance_info_cache with network_info: [{"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0ee00a7d-f48e-4a71-8c59-aac87adac13a req-48da6a63-868f-42e8-b33a-cec644b6d0d7 service nova] Releasing lock "refresh_cache-9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:19:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Instance destroyed successfully.
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.objects.instance [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lazy-loading 'resources' on Instance uuid 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1648411735',display_name='tempest-TestVolumeBootPattern-server-1648411735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1648411735',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa7427nT/h+dP7+/bnJuIJcMTGnHpeVAb1oNNqtK21dXaqmRAWwWcaujHt2L+j5C2+/l6EIMaQFYh3gGRqZPKALkSNznKQBFSqKFjDRj0azYgJALP6WKdLeWRVXIjE03g==',key_name='tempest-TestVolumeBootPattern-460362655',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:15:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9933f68af5d6419e92195eb3b49687a8',ramdisk_id='',reservation_id='r-pyllp4a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1708118170',owner_user_name='tempest-TestVolumeBootPattern-1708118170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:15:03Z,user_data=None,user_id='d54101aceab04126ba338c9965790cf3',uuid=9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converting VIF {"id": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "address": "fa:16:3e:7b:d3:33", "network": {"id": "501f8edc-5de9-4a60-b27f-629b08b87c03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-338155431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9933f68af5d6419e92195eb3b49687a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df50ef7-e2", "ovs_interfaceid": "6df50ef7-e282-4d9c-aa2d-7a372a0c2022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_vif [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df50ef7-e2, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:50 user nova-compute[72780]: INFO os_vif [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d3:33,bridge_name='br-int',has_traffic_filtering=True,id=6df50ef7-e282-4d9c-aa2d-7a372a0c2022,network=Network(501f8edc-5de9-4a60-b27f-629b08b87c03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df50ef7-e2')
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etdWkaDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:19:50 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ca0f0-ab7f-447d-acb6-6fbf4426c233]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b924c4-6093-48f7-93c4-9c7dcdd1101d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:19:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c (non-flash)
Aug 09 01:19:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa0685480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c40c16-acdd-43fa-9dce-675f22ed3665]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[831bb266-63e0-4793-af10-1c68573630af]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e7a32-94f6-4243-ad27-ddd2ba861fd3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[716532f8-1e5e-42e5-a985-5200926e9da1]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9f5ab48b-2a279246f41904be', '/dev/disk/by-id/scsi-23261323739323436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9f5ab48b') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218efd9-30b1-44a3-b7f7-cea7a3cb2f29]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb7eab-efd7-496a-a14a-6465a3cf1d61]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71cc0da-93ee-434d-8446-a0c26d1c2649]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260]
Aug 09 01:19:50 user nova-compute[72780]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c, portal: 172.16.0.220,3260] successful.
Aug 09 01:19:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db25c212-bd25-4e1c-b4e7-c3a6b855035c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec26b7-aa6d-4dc3-bbcb-fc6d8b6678cb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] <== disconnect_volume: return (266ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:19:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:19:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Deleting instance files /opt/stack/data/nova/instances/9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf_del
Aug 09 01:19:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Deletion of /opt/stack/data/nova/instances/9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf_del complete
Aug 09 01:19:51 user nova-compute[72780]: INFO nova.compute.manager [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 09 01:19:51 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:19:51 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:19:51 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:19:51 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:19:51 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Took 0.49 seconds to deallocate network for instance.
Aug 09 01:19:52 user nova-compute[72780]: INFO nova.compute.manager [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Took 0.69 seconds to detach 1 volumes for instance.
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] Acquiring lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] No waiting events found dispatching network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:19:52 user nova-compute[72780]: WARNING nova.compute.manager [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received unexpected event network-vif-plugged-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 for instance with vm_state deleted and task_state None.
Aug 09 01:19:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-b070cc20-ea54-445c-9b9b-cd60b7ce975c req-8e6533d5-07f2-48e7-aa55-eb2b98c23506 service nova] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Received event network-vif-deleted-6df50ef7-e282-4d9c-aa2d-7a372a0c2022 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:52 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Deleted allocations for instance 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf
Aug 09 01:19:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-68643415-ffd2-4cc5-99b7-82abe6b53ec6 tempest-TestVolumeBootPattern-1708118170 tempest-TestVolumeBootPattern-1708118170-project-member] Lock "9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.711s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:19:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:19:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691543990.6752083, 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:20:05 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] VM Stopped (Lifecycle Event)
Aug 09 01:20:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-66084d8d-7b96-4e2b-9ecb-fe3194654d5a None None] [instance: 9ba7e376-47f7-4df6-bbf5-d67e5dfc10cf] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:20:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-changed-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:09 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Refreshing instance network info cache due to event network-changed-996a6df7-d956-48a0-920a-7b5173c4f13d. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:20:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] Acquiring lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:20:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] Acquired lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:20:09 user nova-compute[72780]: DEBUG nova.network.neutron [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Refreshing network info cache for port 996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG nova.objects.instance [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'flavor' on Instance uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Ignoring supplied device name: /dev/vdb
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:10 user nova-compute[72780]: INFO nova.compute.manager [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Attaching volume ff6d5e3b-46c2-44b7-80f7-31cef5393b9f to /dev/vdb
Aug 09 01:20:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updated VIF entry in instance network info cache for port 996a6df7-d956-48a0-920a-7b5173c4f13d. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG nova.network.neutron [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updating instance_info_cache with network_info: [{"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd9bfb53-b1fc-486e-86e6-5f9f134cbbaa req-d46790d0-0563-4f78-ad46-6c95d52fd7c4 service nova] Releasing lock "refresh_cache-61574b0b-f8f7-42ae-8580-082b2deaf310" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG os_brick.utils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4bfb6b-762d-4e46-9b1f-bcb8fa710c7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[873645d8-d756-4fac-b4dd-4f383ba106fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b28de1-0cee-4734-8875-ac4753839dec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d88adb7-16cd-4d6d-89cf-dcc6baae9263]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:20:10 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:20:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef9c1f6-afe9-41d8-b69d-7b619af8efc9]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG os_brick.utils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updating existing volume attachment record: d90898bf-2974-4df9-a007-1fce7a5bd18d {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:20:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImhDbVKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:20:17 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:20:17 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:20:17 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd341598-751f-4abb-9a9c-e41d6ed11a1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:20:17 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d92be-901a-4a0e-a79f-3fc974b636cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f] added
Aug 09 01:20:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[663515fd-99d4-4bd1-a4f1-d26e1a63e448]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcba129-dcd1-4d3c-aeb7-d7d26feebbe3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImhDbVKC {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImhDbVKC" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed87cadd-f3a1-4195-a692-36b1ecd47c05]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ImhDbVKC'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f1418-a6d7-4aa0-8115-73c36dacf8fa]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[817dd5fb-47a7-44a3-b123-91b4287c4ea3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:20:18 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:20:18 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:20:18 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:20:18 user nova-compute[72780]: 
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a61e697-deb6-4c07-8517-2702aebb9ebd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260]
Aug 09 01:20:18 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260] successful.
Aug 09 01:20:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d796249b-779b-4397-ac6c-997aa9585a58]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee773a5-245c-4d0a-8e3e-741e888de072]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f (non-flash)
Aug 09 01:20:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f (non-flash)
Aug 09 01:20:18 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08bf7f-7c1f-4864-99e5-1cb92ea9062c]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:20:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImhDbVKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23435333038393263', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435333038393263', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'flavor' on Instance uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:20:19 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:20:19 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:20:19 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:20:19 user nova-compute[72780]:   <serial>ff6d5e3b-46c2-44b7-80f7-31cef5393b9f</serial>
Aug 09 01:20:19 user nova-compute[72780]: </disk>
Aug 09 01:20:19 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] No VIF found with MAC fa:16:3e:16:62:2d, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:20:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-db7be13d-34ab-480f-b266-238299684904 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.499s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:21 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:20:21 user nova-compute[72780]: INFO nova.compute.claims [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Claim successful on node user
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:20:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.policy [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b17e92fe6f4141a19ae4fa94c24eec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85055d2cc3d47fdb496d109879dcf2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:20:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Creating image(s)
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "/opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "/opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "30153b777f0e9c5007cf7138bfc8e19da27b32bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "30153b777f0e9c5007cf7138bfc8e19da27b32bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:22 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.part --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG nova.virt.images [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22 was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.part /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Successfully created port: 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.part /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.converted" returned: 0 in 0.334s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "30153b777f0e9c5007cf7138bfc8e19da27b32bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.205s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "30153b777f0e9c5007cf7138bfc8e19da27b32bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "30153b777f0e9c5007cf7138bfc8e19da27b32bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf,backing_fmt=raw /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf,backing_fmt=raw /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk 1073741824" returned: 0 in 0.060s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "30153b777f0e9c5007cf7138bfc8e19da27b32bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Successfully updated port: 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing instance network info cache due to event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Cannot resize image /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'migration_context' on Instance uuid eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Ensure instance console log exists: /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8b3ddbb7-933c-4181-ac53-f61519e7136d req-fb7767c2-dc95-4e62-ade1-ac68bbc05700 service nova] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance network_info: |[{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Start _get_guest_xml network_info=[{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T01:20:19Z,direct_url=<?>,disk_format='qcow2',id=f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22,min_disk=0,min_ram=0,name='tempest-scenario-img--825960881',owner='a85055d2cc3d47fdb496d109879dcf2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T01:20:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:20:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:20:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T01:20:19Z,direct_url=<?>,disk_format='qcow2',id=f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22,min_disk=0,min_ram=0,name='tempest-scenario-img--825960881',owner='a85055d2cc3d47fdb496d109879dcf2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T01:20:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-103639508',display_name='tempest-TestMinimumBasicScenario-server-103639508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-103639508',id=47,image_ref='f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8X8c1BVZ+LSFCEagJCQJfsoSRMLTR9o6b4qqhZa0UaXRDpU2omD5aMLCDFWRyf7rVbcJpVqYFHIdGZCySxMTIVkbIf2eJj3aKYyqAQU9KMtIOrqK13tNRff/aJsqGb3Q==',key_name='tempest-TestMinimumBasicScenario-612467624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-zv4m227m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:20:22Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=eb03a2d2-6bec-43a8-bae9-ff7ab47ab840,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'pci_devices' on Instance uuid eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:20:24 user nova-compute[72780]:   <uuid>eb03a2d2-6bec-43a8-bae9-ff7ab47ab840</uuid>
Aug 09 01:20:24 user nova-compute[72780]:   <name>instance-0000002f</name>
Aug 09 01:20:24 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:20:24 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:20:24 user nova-compute[72780]:   <metadata>
Aug 09 01:20:24 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:20:24 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:20:24 user nova-compute[72780]:       <nova:name>tempest-TestMinimumBasicScenario-server-103639508</nova:name>
Aug 09 01:20:24 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:20:24</nova:creationTime>
Aug 09 01:20:24 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:20:24 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:20:24 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:20:24 user nova-compute[72780]:       <nova:owner>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:user uuid="b17e92fe6f4141a19ae4fa94c24eec52">tempest-TestMinimumBasicScenario-546637949-project-member</nova:user>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:project uuid="a85055d2cc3d47fdb496d109879dcf2c">tempest-TestMinimumBasicScenario-546637949</nova:project>
Aug 09 01:20:24 user nova-compute[72780]:       </nova:owner>
Aug 09 01:20:24 user nova-compute[72780]:       <nova:root type="image" uuid="f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22"/>
Aug 09 01:20:24 user nova-compute[72780]:       <nova:ports>
Aug 09 01:20:24 user nova-compute[72780]:         <nova:port uuid="1e78b117-43ae-4196-a94f-4ff4ab95139e">
Aug 09 01:20:24 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 01:20:24 user nova-compute[72780]:         </nova:port>
Aug 09 01:20:24 user nova-compute[72780]:       </nova:ports>
Aug 09 01:20:24 user nova-compute[72780]:     </nova:instance>
Aug 09 01:20:24 user nova-compute[72780]:   </metadata>
Aug 09 01:20:24 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:20:24 user nova-compute[72780]:     <system>
Aug 09 01:20:24 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:20:24 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:20:24 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:20:24 user nova-compute[72780]:       <entry name="serial">eb03a2d2-6bec-43a8-bae9-ff7ab47ab840</entry>
Aug 09 01:20:24 user nova-compute[72780]:       <entry name="uuid">eb03a2d2-6bec-43a8-bae9-ff7ab47ab840</entry>
Aug 09 01:20:24 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:20:24 user nova-compute[72780]:     </system>
Aug 09 01:20:24 user nova-compute[72780]:   </sysinfo>
Aug 09 01:20:24 user nova-compute[72780]:   <os>
Aug 09 01:20:24 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:20:24 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:20:24 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:20:24 user nova-compute[72780]:   </os>
Aug 09 01:20:24 user nova-compute[72780]:   <features>
Aug 09 01:20:24 user nova-compute[72780]:     <acpi/>
Aug 09 01:20:24 user nova-compute[72780]:     <apic/>
Aug 09 01:20:24 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:20:24 user nova-compute[72780]:   </features>
Aug 09 01:20:24 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:20:24 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:20:24 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:20:24 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:20:24 user nova-compute[72780]:   </clock>
Aug 09 01:20:24 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:20:24 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:20:24 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:20:24 user nova-compute[72780]:   </cpu>
Aug 09 01:20:24 user nova-compute[72780]:   <devices>
Aug 09 01:20:24 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:20:24 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:20:24 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk"/>
Aug 09 01:20:24 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:20:24 user nova-compute[72780]:     </disk>
Aug 09 01:20:24 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:20:24 user nova-compute[72780]:       <mac address="fa:16:3e:42:36:6b"/>
Aug 09 01:20:24 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:20:24 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:20:24 user nova-compute[72780]:       <target dev="tap1e78b117-43"/>
Aug 09 01:20:24 user nova-compute[72780]:     </interface>
Aug 09 01:20:24 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:20:24 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/console.log" append="off"/>
Aug 09 01:20:24 user nova-compute[72780]:     </serial>
Aug 09 01:20:24 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:20:24 user nova-compute[72780]:     <video>
Aug 09 01:20:24 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:20:24 user nova-compute[72780]:     </video>
Aug 09 01:20:24 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:20:24 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:20:24 user nova-compute[72780]:     </rng>
Aug 09 01:20:24 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:20:24 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:20:24 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:20:24 user nova-compute[72780]:     </memballoon>
Aug 09 01:20:24 user nova-compute[72780]:   </devices>
Aug 09 01:20:24 user nova-compute[72780]: </domain>
Aug 09 01:20:24 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-103639508',display_name='tempest-TestMinimumBasicScenario-server-103639508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-103639508',id=47,image_ref='f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8X8c1BVZ+LSFCEagJCQJfsoSRMLTR9o6b4qqhZa0UaXRDpU2omD5aMLCDFWRyf7rVbcJpVqYFHIdGZCySxMTIVkbIf2eJj3aKYyqAQU9KMtIOrqK13tNRff/aJsqGb3Q==',key_name='tempest-TestMinimumBasicScenario-612467624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-zv4m227m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:20:22Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=eb03a2d2-6bec-43a8-bae9-ff7ab47ab840,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG os_vif [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e78b117-43, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e78b117-43, col_values=(('external_ids', {'iface-id': '1e78b117-43ae-4196-a94f-4ff4ab95139e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:36:6b', 'vm-uuid': 'eb03a2d2-6bec-43a8-bae9-ff7ab47ab840'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:24 user nova-compute[72780]: INFO os_vif [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43')
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:20:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No VIF found with MAC fa:16:3e:42:36:6b, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-f53f1e0d-0b1c-478a-b07f-e0f09f372049 req-ea97e37e-0b6f-47de-9dab-b26595b3b934 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f53f1e0d-0b1c-478a-b07f-e0f09f372049 req-ea97e37e-0b6f-47de-9dab-b26595b3b934 service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f53f1e0d-0b1c-478a-b07f-e0f09f372049 req-ea97e37e-0b6f-47de-9dab-b26595b3b934 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f53f1e0d-0b1c-478a-b07f-e0f09f372049 req-ea97e37e-0b6f-47de-9dab-b26595b3b934 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-f53f1e0d-0b1c-478a-b07f-e0f09f372049 req-ea97e37e-0b6f-47de-9dab-b26595b3b934 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:26 user nova-compute[72780]: WARNING nova.compute.manager [req-f53f1e0d-0b1c-478a-b07f-e0f09f372049 req-ea97e37e-0b6f-47de-9dab-b26595b3b934 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state building and task_state spawning.
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544028.3059735, eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] VM Resumed (Lifecycle Event)
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance spawned successfully.
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544028.3071344, eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] VM Started (Lifecycle Event)
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-1cd34a09-5ce0-4ef3-afb2-c8d22fe3180c req-0e5c270a-0339-4fe5-bc90-77d9ec4af73c service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1cd34a09-5ce0-4ef3-afb2-c8d22fe3180c req-0e5c270a-0339-4fe5-bc90-77d9ec4af73c service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1cd34a09-5ce0-4ef3-afb2-c8d22fe3180c req-0e5c270a-0339-4fe5-bc90-77d9ec4af73c service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1cd34a09-5ce0-4ef3-afb2-c8d22fe3180c req-0e5c270a-0339-4fe5-bc90-77d9ec4af73c service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-1cd34a09-5ce0-4ef3-afb2-c8d22fe3180c req-0e5c270a-0339-4fe5-bc90-77d9ec4af73c service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:28 user nova-compute[72780]: WARNING nova.compute.manager [req-1cd34a09-5ce0-4ef3-afb2-c8d22fe3180c req-0e5c270a-0339-4fe5-bc90-77d9ec4af73c service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state building and task_state spawning.
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Took 6.66 seconds to build instance.
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a3ba760d-e2b3-4ea7-8472-78ca14bc718e tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.752s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:28 user nova-compute[72780]: INFO nova.compute.manager [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Terminating instance
Aug 09 01:20:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Instance destroyed successfully.
Aug 09 01:20:29 user nova-compute[72780]: DEBUG nova.objects.instance [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'resources' on Instance uuid 841d4941-6521-453f-82ed-784ea088187f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1775000355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1775000355',id=41,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhdtKTqLQZKty0d85BDuWqyX9TWWWgMYX73RdNXVOB5FK/I7CzhNiw+r6v+m5GaQ+dnt8PjtUliKD8KeDUrncDeJyH0qY9raQaf5G1hYaEXK7JHhMojREzYsxn6kaGgJg==',key_name='tempest-keypair-1784194185',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-0nabra6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=841d4941-6521-453f-82ed-784ea088187f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "address": "fa:16:3e:e3:be:76", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7b8575-99", "ovs_interfaceid": "ee7b8575-9982-4075-a6f7-103f8f626ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG os_vif [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee7b8575-99, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:29 user nova-compute[72780]: INFO os_vif [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:be:76,bridge_name='br-int',has_traffic_filtering=True,id=ee7b8575-9982-4075-a6f7-103f8f626ff3,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7b8575-99')
Aug 09 01:20:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Deleting instance files /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f_del
Aug 09 01:20:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Deletion of /opt/stack/data/nova/instances/841d4941-6521-453f-82ed-784ea088187f_del complete
Aug 09 01:20:29 user nova-compute[72780]: INFO nova.compute.manager [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 841d4941-6521-453f-82ed-784ea088187f] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 09 01:20:29 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:20:29 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:30 user nova-compute[72780]: WARNING nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state active and task_state deleting.
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:30 user nova-compute[72780]: WARNING nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state active and task_state deleting.
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:30 user nova-compute[72780]: WARNING nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state active and task_state deleting.
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-fa8b0fad-0443-4191-90c2-bf28bf069ae2 req-59a2dff2-d8ab-482b-909a-df71fbe16d93 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-unplugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Skipping network cache update for instance because it is being deleted. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:31 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] Took 1.55 seconds to deallocate network for instance.
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-4f49f3b9-3cf9-4ab7-ae09-d9f51f431417 req-aa9b1ac8-74ac-4b75-972f-46524f12ad27 service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-deleted-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:31 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Deleted allocations for instance 841d4941-6521-453f-82ed-784ea088187f
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:20:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-da1b826c-05bf-46dd-90ad-f0517f3b9b0f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "841d4941-6521-453f-82ed-784ea088187f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.961s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e197d25-ca42-43ce-b285-55e21267f997 req-a04f377a-a962-45e7-9228-5b45454ede5d service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e197d25-ca42-43ce-b285-55e21267f997 req-a04f377a-a962-45e7-9228-5b45454ede5d service nova] Acquiring lock "841d4941-6521-453f-82ed-784ea088187f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e197d25-ca42-43ce-b285-55e21267f997 req-a04f377a-a962-45e7-9228-5b45454ede5d service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8e197d25-ca42-43ce-b285-55e21267f997 req-a04f377a-a962-45e7-9228-5b45454ede5d service nova] Lock "841d4941-6521-453f-82ed-784ea088187f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:32 user nova-compute[72780]: DEBUG nova.compute.manager [req-8e197d25-ca42-43ce-b285-55e21267f997 req-a04f377a-a962-45e7-9228-5b45454ede5d service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] No waiting events found dispatching network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:32 user nova-compute[72780]: WARNING nova.compute.manager [req-8e197d25-ca42-43ce-b285-55e21267f997 req-a04f377a-a962-45e7-9228-5b45454ede5d service nova] [instance: 841d4941-6521-453f-82ed-784ea088187f] Received unexpected event network-vif-plugged-ee7b8575-9982-4075-a6f7-103f8f626ff3 for instance with vm_state deleted and task_state None.
Aug 09 01:20:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:20:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:20:42 user nova-compute[72780]: INFO nova.compute.claims [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Claim successful on node user
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.network.neutron [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:20:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.policy [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59257e56086046b0a27ce3880c309586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9784ac1238a41e598ec36907111c770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:20:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Creating image(s)
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk 1073741824" returned: 0 in 0.075s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Cannot resize image /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG nova.objects.instance [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'migration_context' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Ensure instance console log exists: /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:43 user nova-compute[72780]: DEBUG nova.network.neutron [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Successfully created port: 937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.network.neutron [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Successfully updated port: 937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.network.neutron [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing instance network info cache due to event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.network.neutron [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544029.5865972, 841d4941-6521-453f-82ed-784ea088187f => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:20:44 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 841d4941-6521-453f-82ed-784ea088187f] VM Stopped (Lifecycle Event)
Aug 09 01:20:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2d4381ba-8ef4-4dbf-b18e-adb096748d75 None None] [instance: 841d4941-6521-453f-82ed-784ea088187f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.network.neutron [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance network_info: |[{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.network.neutron [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Start _get_guest_xml network_info=[{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:20:44 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:20:44 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:20:44 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516536775',display_name='tempest-ServerRescueNegativeTestJSON-server-1516536775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516536775',id=48,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKu0i3FnQRZtx4XRq4/FdFbFeX7zEePWtu9dZo+Kz046V5fxY3Naf1dzy8LQVIfdH7jVg9QIP1LQc3ozYndIRXEXi2QuUsVADIpF4FOvOVNpKpWTKKAsoeFs0NxUm/gFg==',key_name='tempest-keypair-2084992097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ymoavt3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59257e56086046b0a27ce3880c309586',uuid=d4532a1e-2830-4e60-9134-c9a34eec0d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.objects.instance [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'pci_devices' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:20:45 user nova-compute[72780]:   <uuid>d4532a1e-2830-4e60-9134-c9a34eec0d23</uuid>
Aug 09 01:20:45 user nova-compute[72780]:   <name>instance-00000030</name>
Aug 09 01:20:45 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:20:45 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:20:45 user nova-compute[72780]:   <metadata>
Aug 09 01:20:45 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:20:45 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:20:45 user nova-compute[72780]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1516536775</nova:name>
Aug 09 01:20:45 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:20:44</nova:creationTime>
Aug 09 01:20:45 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:20:45 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:20:45 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:20:45 user nova-compute[72780]:       <nova:owner>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:user uuid="59257e56086046b0a27ce3880c309586">tempest-ServerRescueNegativeTestJSON-1588572554-project-member</nova:user>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:project uuid="b9784ac1238a41e598ec36907111c770">tempest-ServerRescueNegativeTestJSON-1588572554</nova:project>
Aug 09 01:20:45 user nova-compute[72780]:       </nova:owner>
Aug 09 01:20:45 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:20:45 user nova-compute[72780]:       <nova:ports>
Aug 09 01:20:45 user nova-compute[72780]:         <nova:port uuid="937fd312-f2e3-4cde-94a1-5a259c56d803">
Aug 09 01:20:45 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:20:45 user nova-compute[72780]:         </nova:port>
Aug 09 01:20:45 user nova-compute[72780]:       </nova:ports>
Aug 09 01:20:45 user nova-compute[72780]:     </nova:instance>
Aug 09 01:20:45 user nova-compute[72780]:   </metadata>
Aug 09 01:20:45 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:20:45 user nova-compute[72780]:     <system>
Aug 09 01:20:45 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:20:45 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:20:45 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:20:45 user nova-compute[72780]:       <entry name="serial">d4532a1e-2830-4e60-9134-c9a34eec0d23</entry>
Aug 09 01:20:45 user nova-compute[72780]:       <entry name="uuid">d4532a1e-2830-4e60-9134-c9a34eec0d23</entry>
Aug 09 01:20:45 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:20:45 user nova-compute[72780]:     </system>
Aug 09 01:20:45 user nova-compute[72780]:   </sysinfo>
Aug 09 01:20:45 user nova-compute[72780]:   <os>
Aug 09 01:20:45 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:20:45 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:20:45 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:20:45 user nova-compute[72780]:   </os>
Aug 09 01:20:45 user nova-compute[72780]:   <features>
Aug 09 01:20:45 user nova-compute[72780]:     <acpi/>
Aug 09 01:20:45 user nova-compute[72780]:     <apic/>
Aug 09 01:20:45 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:20:45 user nova-compute[72780]:   </features>
Aug 09 01:20:45 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:20:45 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:20:45 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:20:45 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:20:45 user nova-compute[72780]:   </clock>
Aug 09 01:20:45 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:20:45 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:20:45 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:20:45 user nova-compute[72780]:   </cpu>
Aug 09 01:20:45 user nova-compute[72780]:   <devices>
Aug 09 01:20:45 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:20:45 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:20:45 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk"/>
Aug 09 01:20:45 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:20:45 user nova-compute[72780]:     </disk>
Aug 09 01:20:45 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:20:45 user nova-compute[72780]:       <mac address="fa:16:3e:b2:e5:e8"/>
Aug 09 01:20:45 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:20:45 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:20:45 user nova-compute[72780]:       <target dev="tap937fd312-f2"/>
Aug 09 01:20:45 user nova-compute[72780]:     </interface>
Aug 09 01:20:45 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:20:45 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/console.log" append="off"/>
Aug 09 01:20:45 user nova-compute[72780]:     </serial>
Aug 09 01:20:45 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:20:45 user nova-compute[72780]:     <video>
Aug 09 01:20:45 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:20:45 user nova-compute[72780]:     </video>
Aug 09 01:20:45 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:20:45 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:20:45 user nova-compute[72780]:     </rng>
Aug 09 01:20:45 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:20:45 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:20:45 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:20:45 user nova-compute[72780]:     </memballoon>
Aug 09 01:20:45 user nova-compute[72780]:   </devices>
Aug 09 01:20:45 user nova-compute[72780]: </domain>
Aug 09 01:20:45 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516536775',display_name='tempest-ServerRescueNegativeTestJSON-server-1516536775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516536775',id=48,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKu0i3FnQRZtx4XRq4/FdFbFeX7zEePWtu9dZo+Kz046V5fxY3Naf1dzy8LQVIfdH7jVg9QIP1LQc3ozYndIRXEXi2QuUsVADIpF4FOvOVNpKpWTKKAsoeFs0NxUm/gFg==',key_name='tempest-keypair-2084992097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ymoavt3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59257e56086046b0a27ce3880c309586',uuid=d4532a1e-2830-4e60-9134-c9a34eec0d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG os_vif [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap937fd312-f2, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap937fd312-f2, col_values=(('external_ids', {'iface-id': '937fd312-f2e3-4cde-94a1-5a259c56d803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e5:e8', 'vm-uuid': 'd4532a1e-2830-4e60-9134-c9a34eec0d23'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:45 user nova-compute[72780]: INFO os_vif [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2')
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:b2:e5:e8, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.network.neutron [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updated VIF entry in instance network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.network.neutron [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-269ac3ba-574b-4d84-bd1d-44314560c6f2 req-1bb4d3ba-dc16-4077-85fb-78c6edb6fde9 service nova] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:20:48 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544048.7271724, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:20:48 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Resumed (Lifecycle Event)
Aug 09 01:20:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-bbdf0ebd-73be-44ed-8f92-43a3da021253 req-b039a86a-942f-4f1a-872f-a50e44778417 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bbdf0ebd-73be-44ed-8f92-43a3da021253 req-b039a86a-942f-4f1a-872f-a50e44778417 service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bbdf0ebd-73be-44ed-8f92-43a3da021253 req-b039a86a-942f-4f1a-872f-a50e44778417 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bbdf0ebd-73be-44ed-8f92-43a3da021253 req-b039a86a-942f-4f1a-872f-a50e44778417 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-bbdf0ebd-73be-44ed-8f92-43a3da021253 req-b039a86a-942f-4f1a-872f-a50e44778417 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:49 user nova-compute[72780]: WARNING nova.compute.manager [req-bbdf0ebd-73be-44ed-8f92-43a3da021253 req-b039a86a-942f-4f1a-872f-a50e44778417 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state building and task_state spawning.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-23297bd2-9934-4518-b1f3-74945cb9d00f req-cf951d51-0175-4ce1-80c7-8ddac1c4ed59 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-23297bd2-9934-4518-b1f3-74945cb9d00f req-cf951d51-0175-4ce1-80c7-8ddac1c4ed59 service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-23297bd2-9934-4518-b1f3-74945cb9d00f req-cf951d51-0175-4ce1-80c7-8ddac1c4ed59 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-23297bd2-9934-4518-b1f3-74945cb9d00f req-cf951d51-0175-4ce1-80c7-8ddac1c4ed59 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [req-23297bd2-9934-4518-b1f3-74945cb9d00f req-cf951d51-0175-4ce1-80c7-8ddac1c4ed59 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:49 user nova-compute[72780]: WARNING nova.compute.manager [req-23297bd2-9934-4518-b1f3-74945cb9d00f req-cf951d51-0175-4ce1-80c7-8ddac1c4ed59 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state building and task_state spawning.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance spawned successfully.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:20:49 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:20:49 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8195MB free_disk=25.02490234375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.compute.manager [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Detaching volume ff6d5e3b-46c2-44b7-80f7-31cef5393b9f
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544048.7292547, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Started (Lifecycle Event)
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.virt.block_device [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Attempting to driver detach volume ff6d5e3b-46c2-44b7-80f7-31cef5393b9f from mountpoint /dev/vdb
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Attempting to detach device vdb from instance 61574b0b-f8f7-42ae-8580-082b2deaf310 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:20:49 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:20:49 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:20:49 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:20:49 user nova-compute[72780]:   <serial>ff6d5e3b-46c2-44b7-80f7-31cef5393b9f</serial>
Aug 09 01:20:49 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:20:49 user nova-compute[72780]: </disk>
Aug 09 01:20:49 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 61574b0b-f8f7-42ae-8580-082b2deaf310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully detached device vdb from instance 61574b0b-f8f7-42ae-8580-082b2deaf310 from the persistent domain config.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61574b0b-f8f7-42ae-8580-082b2deaf310 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:20:49 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:20:49 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:20:49 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:20:49 user nova-compute[72780]:   <serial>ff6d5e3b-46c2-44b7-80f7-31cef5393b9f</serial>
Aug 09 01:20:49 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:20:49 user nova-compute[72780]: </disk>
Aug 09 01:20:49 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.compute.manager [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Took 7.02 seconds to build instance.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-43641588-58d2-4373-9b80-c4524aab35c5 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544049.675789, 61574b0b-f8f7-42ae-8580-082b2deaf310 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:20:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully detached device vdb from instance 61574b0b-f8f7-42ae-8580-082b2deaf310 from the live domain config.
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImhDbVKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:20:49 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa49e930-1cc6-43c8-8bca-521ec9e8db79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8610b0-2fe8-40b0-91c4-afbeb529f5e2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f (non-flash)
Aug 09 01:20:49 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f (non-flash)
Aug 09 01:20:49 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa063c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f1e7f-45df-4b30-b6a1-2dd1da062f40]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f955226c-7e63-4216-a074-447f7fecd8c7]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05a636b-efa8-4bf8-b00a-1d5e1db7ea51]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5825d77-f03f-4a20-9a4a-695e888cf301]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c7a4fe-58a0-4083-acf6-b661aea71154]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb95e240-08b6-46a1-bff9-961e164b192e]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260]
Aug 09 01:20:49 user nova-compute[72780]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f, portal: 172.16.0.220,3260] successful.
Aug 09 01:20:49 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a80dc44-3fe2-4de1-bc58-85532275b0ef]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== disconnect_volume: return (307ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:20:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG nova.objects.instance [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'flavor' on Instance uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-de55b47e-3612-4835-aad2-ec4fcfcdf480 tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.809s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:50 user nova-compute[72780]: INFO nova.compute.manager [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Terminating instance
Aug 09 01:20:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:20:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f7ce7ce-e188-4ab6-92c7-ed94dd5b5e50 req-62d15520-2d01-4833-8013-7025873bc1a8 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-vif-unplugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f7ce7ce-e188-4ab6-92c7-ed94dd5b5e50 req-62d15520-2d01-4833-8013-7025873bc1a8 service nova] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f7ce7ce-e188-4ab6-92c7-ed94dd5b5e50 req-62d15520-2d01-4833-8013-7025873bc1a8 service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f7ce7ce-e188-4ab6-92c7-ed94dd5b5e50 req-62d15520-2d01-4833-8013-7025873bc1a8 service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f7ce7ce-e188-4ab6-92c7-ed94dd5b5e50 req-62d15520-2d01-4833-8013-7025873bc1a8 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] No waiting events found dispatching network-vif-unplugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f7ce7ce-e188-4ab6-92c7-ed94dd5b5e50 req-62d15520-2d01-4833-8013-7025873bc1a8 service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-vif-unplugged-996a6df7-d956-48a0-920a-7b5173c4f13d for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Instance destroyed successfully.
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lazy-loading 'resources' on Instance uuid 61574b0b-f8f7-42ae-8580-082b2deaf310 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1100154912',display_name='tempest-VolumesSnapshotTestJSON-instance-1100154912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1100154912',id=46,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6O7AQhMuZfmNsA0tI/j7M//XVwLAufXDY/d6PC7bb50vIoUfdJyoSFD4VqXtBhY80KBIkvarbS+0t0puXldOzc168iVlkfTzDGB+DWxPUzAQpW/gaAKbKpbWOZi8QxGg==',key_name='tempest-keypair-1803731076',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16197c0497354e32b5ead73377548f30',ramdisk_id='',reservation_id='r-j12x4ar9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-468237489',owner_user_name='tempest-VolumesSnapshotTestJSON-468237489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9ec6e6c8ce14879a1397fec6429c4d1',uuid=61574b0b-f8f7-42ae-8580-082b2deaf310,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converting VIF {"id": "996a6df7-d956-48a0-920a-7b5173c4f13d", "address": "fa:16:3e:16:62:2d", "network": {"id": "fa094168-66ec-4c4c-8a0a-c2bca841010c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1007044602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16197c0497354e32b5ead73377548f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996a6df7-d9", "ovs_interfaceid": "996a6df7-d956-48a0-920a-7b5173c4f13d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_vif [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap996a6df7-d9, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:20:51 user nova-compute[72780]: INFO os_vif [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:62:2d,bridge_name='br-int',has_traffic_filtering=True,id=996a6df7-d956-48a0-920a-7b5173c4f13d,network=Network(fa094168-66ec-4c4c-8a0a-c2bca841010c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996a6df7-d9')
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImhDbVKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:20:51 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff6d5e3b-46c2-44b7-80f7-31cef5393b9f', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dd1813-d2c6-41c7-a344-50cfa6c5ad1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:51 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 09 01:20:51 user nova-compute[72780]: 
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1247137d-e1f5-437e-8e3e-68cf296a24aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:20:51 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:20:51 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:20:51 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:20:51 user nova-compute[72780]: 
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01d75b0>, {}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Disconnecting from: [] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] <== disconnect_volume: return (52ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:20:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Deleting instance files /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310_del
Aug 09 01:20:51 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Deletion of /opt/stack/data/nova/instances/61574b0b-f8f7-42ae-8580-082b2deaf310_del complete
Aug 09 01:20:51 user nova-compute[72780]: INFO nova.compute.manager [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 01:20:51 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:20:51 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:20:52 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:20:53 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Took 1.20 seconds to deallocate network for instance.
Aug 09 01:20:53 user nova-compute[72780]: WARNING nova.volume.cinder [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Attachment d90898bf-2974-4df9-a007-1fce7a5bd18d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d90898bf-2974-4df9-a007-1fce7a5bd18d. (HTTP 404) (Request-ID: req-cdfc85b3-6d43-4f01-b380-7070f973c234)
Aug 09 01:20:53 user nova-compute[72780]: INFO nova.compute.manager [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] Acquiring lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] No waiting events found dispatching network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:20:53 user nova-compute[72780]: WARNING nova.compute.manager [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received unexpected event network-vif-plugged-996a6df7-d956-48a0-920a-7b5173c4f13d for instance with vm_state deleted and task_state None.
Aug 09 01:20:53 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d0ff0e5-da9b-4341-9c47-51545524ff9f req-48612c81-c983-47ae-951a-c096f517bb6f service nova] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Received event network-vif-deleted-996a6df7-d956-48a0-920a-7b5173c4f13d {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:20:53 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Deleted allocations for instance 61574b0b-f8f7-42ae-8580-082b2deaf310
Aug 09 01:20:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d4233761-771c-4b51-abf8-b7719239a81e tempest-VolumesSnapshotTestJSON-468237489 tempest-VolumesSnapshotTestJSON-468237489-project-member] Lock "61574b0b-f8f7-42ae-8580-082b2deaf310" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.579s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:20:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:20:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:06 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544051.6499903, 61574b0b-f8f7-42ae-8580-082b2deaf310 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:21:06 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] VM Stopped (Lifecycle Event)
Aug 09 01:21:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2f822e42-0ccf-40a9-91e8-f532a4b8d14d None None] [instance: 61574b0b-f8f7-42ae-8580-082b2deaf310] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:21:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:21:22 user nova-compute[72780]: INFO nova.compute.claims [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Claim successful on node user
Aug 09 01:21:22 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:21:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.policy [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7abd6cb25b47b58ccd80d9fda7ece0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd3451d1fb641ad8106f8b4bcb68fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:21:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Creating image(s)
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk 1073741824" returned: 0 in 0.048s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Successfully created port: b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Cannot resize image /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'migration_context' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Ensure instance console log exists: /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Successfully updated port: b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing instance network info cache due to event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.neutron [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance network_info: |[{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Start _get_guest_xml network_info=[{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:21:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:21:24 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437117913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437117913',id=49,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgviTv0o/AypdKIzucSq4Y2dL8AuAU/IhSawBkn0h6wtkTZ+gOPrH+m2nS8GLC7LRjrYX5giVN2QlVJwJkCINTEsJv8+uUE3Xd7jK/jFL8f+5cdX00HNuziGyFxPow5Ag==',key_name='tempest-keypair-1605457411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-qgeuxdhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=13b7263c-2f83-4bb6-8459-133e93acba6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'pci_devices' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:21:24 user nova-compute[72780]:   <uuid>13b7263c-2f83-4bb6-8459-133e93acba6e</uuid>
Aug 09 01:21:24 user nova-compute[72780]:   <name>instance-00000031</name>
Aug 09 01:21:24 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:21:24 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:21:24 user nova-compute[72780]:   <metadata>
Aug 09 01:21:24 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:21:24 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:21:24 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-437117913</nova:name>
Aug 09 01:21:24 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:21:24</nova:creationTime>
Aug 09 01:21:24 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:21:24 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:21:24 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:21:24 user nova-compute[72780]:       <nova:owner>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:user uuid="0c7abd6cb25b47b58ccd80d9fda7ece0">tempest-AttachVolumeShelveTestJSON-1412186531-project-member</nova:user>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:project uuid="9dd3451d1fb641ad8106f8b4bcb68fc1">tempest-AttachVolumeShelveTestJSON-1412186531</nova:project>
Aug 09 01:21:24 user nova-compute[72780]:       </nova:owner>
Aug 09 01:21:24 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:21:24 user nova-compute[72780]:       <nova:ports>
Aug 09 01:21:24 user nova-compute[72780]:         <nova:port uuid="b218b39d-459e-4b92-87a2-cdf5233b5324">
Aug 09 01:21:24 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 01:21:24 user nova-compute[72780]:         </nova:port>
Aug 09 01:21:24 user nova-compute[72780]:       </nova:ports>
Aug 09 01:21:24 user nova-compute[72780]:     </nova:instance>
Aug 09 01:21:24 user nova-compute[72780]:   </metadata>
Aug 09 01:21:24 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:21:24 user nova-compute[72780]:     <system>
Aug 09 01:21:24 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:21:24 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:21:24 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:21:24 user nova-compute[72780]:       <entry name="serial">13b7263c-2f83-4bb6-8459-133e93acba6e</entry>
Aug 09 01:21:24 user nova-compute[72780]:       <entry name="uuid">13b7263c-2f83-4bb6-8459-133e93acba6e</entry>
Aug 09 01:21:24 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:21:24 user nova-compute[72780]:     </system>
Aug 09 01:21:24 user nova-compute[72780]:   </sysinfo>
Aug 09 01:21:24 user nova-compute[72780]:   <os>
Aug 09 01:21:24 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:21:24 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:21:24 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:21:24 user nova-compute[72780]:   </os>
Aug 09 01:21:24 user nova-compute[72780]:   <features>
Aug 09 01:21:24 user nova-compute[72780]:     <acpi/>
Aug 09 01:21:24 user nova-compute[72780]:     <apic/>
Aug 09 01:21:24 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:21:24 user nova-compute[72780]:   </features>
Aug 09 01:21:24 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:21:24 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:21:24 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:21:24 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:21:24 user nova-compute[72780]:   </clock>
Aug 09 01:21:24 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:21:24 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:21:24 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:21:24 user nova-compute[72780]:   </cpu>
Aug 09 01:21:24 user nova-compute[72780]:   <devices>
Aug 09 01:21:24 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:21:24 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:21:24 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk"/>
Aug 09 01:21:24 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:21:24 user nova-compute[72780]:     </disk>
Aug 09 01:21:24 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:21:24 user nova-compute[72780]:       <mac address="fa:16:3e:15:db:87"/>
Aug 09 01:21:24 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:21:24 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:21:24 user nova-compute[72780]:       <target dev="tapb218b39d-45"/>
Aug 09 01:21:24 user nova-compute[72780]:     </interface>
Aug 09 01:21:24 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:21:24 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/console.log" append="off"/>
Aug 09 01:21:24 user nova-compute[72780]:     </serial>
Aug 09 01:21:24 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:21:24 user nova-compute[72780]:     <video>
Aug 09 01:21:24 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:21:24 user nova-compute[72780]:     </video>
Aug 09 01:21:24 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:21:24 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:21:24 user nova-compute[72780]:     </rng>
Aug 09 01:21:24 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:21:24 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:21:24 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:21:24 user nova-compute[72780]:     </memballoon>
Aug 09 01:21:24 user nova-compute[72780]:   </devices>
Aug 09 01:21:24 user nova-compute[72780]: </domain>
Aug 09 01:21:24 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437117913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437117913',id=49,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgviTv0o/AypdKIzucSq4Y2dL8AuAU/IhSawBkn0h6wtkTZ+gOPrH+m2nS8GLC7LRjrYX5giVN2QlVJwJkCINTEsJv8+uUE3Xd7jK/jFL8f+5cdX00HNuziGyFxPow5Ag==',key_name='tempest-keypair-1605457411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-qgeuxdhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=13b7263c-2f83-4bb6-8459-133e93acba6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG os_vif [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb218b39d-45, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb218b39d-45, col_values=(('external_ids', {'iface-id': 'b218b39d-459e-4b92-87a2-cdf5233b5324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:db:87', 'vm-uuid': '13b7263c-2f83-4bb6-8459-133e93acba6e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:21:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:24 user nova-compute[72780]: INFO os_vif [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45')
Aug 09 01:21:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:21:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No VIF found with MAC fa:16:3e:15:db:87, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:21:25 user nova-compute[72780]: DEBUG nova.network.neutron [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updated VIF entry in instance network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:21:25 user nova-compute[72780]: DEBUG nova.network.neutron [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:21:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-913e8d53-22f4-4bf0-ac6a-487817a2ef8f req-166b36da-31f2-4f22-a26f-5fa3c1df9966 service nova] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-1bf082db-4b59-4bae-85e6-6d6bc5c5d4d3 req-f5e263e3-fcb8-41a3-854c-aaae7aa1b9bb service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1bf082db-4b59-4bae-85e6-6d6bc5c5d4d3 req-f5e263e3-fcb8-41a3-854c-aaae7aa1b9bb service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1bf082db-4b59-4bae-85e6-6d6bc5c5d4d3 req-f5e263e3-fcb8-41a3-854c-aaae7aa1b9bb service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1bf082db-4b59-4bae-85e6-6d6bc5c5d4d3 req-f5e263e3-fcb8-41a3-854c-aaae7aa1b9bb service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-1bf082db-4b59-4bae-85e6-6d6bc5c5d4d3 req-f5e263e3-fcb8-41a3-854c-aaae7aa1b9bb service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:21:26 user nova-compute[72780]: WARNING nova.compute.manager [req-1bf082db-4b59-4bae-85e6-6d6bc5c5d4d3 req-f5e263e3-fcb8-41a3-854c-aaae7aa1b9bb service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state building and task_state spawning.
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544088.426663, 13b7263c-2f83-4bb6-8459-133e93acba6e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] VM Resumed (Lifecycle Event)
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance spawned successfully.
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544088.4298072, 13b7263c-2f83-4bb6-8459-133e93acba6e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] VM Started (Lifecycle Event)
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:21:28 user nova-compute[72780]: INFO nova.compute.manager [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Took 5.98 seconds to build instance.
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-03bc520a-d869-4346-9cc6-4e1d1a89d193 req-2f745188-9ac1-4c76-9d7d-354432d238d1 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03bc520a-d869-4346-9cc6-4e1d1a89d193 req-2f745188-9ac1-4c76-9d7d-354432d238d1 service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03bc520a-d869-4346-9cc6-4e1d1a89d193 req-2f745188-9ac1-4c76-9d7d-354432d238d1 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-03bc520a-d869-4346-9cc6-4e1d1a89d193 req-2f745188-9ac1-4c76-9d7d-354432d238d1 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-03bc520a-d869-4346-9cc6-4e1d1a89d193 req-2f745188-9ac1-4c76-9d7d-354432d238d1 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:21:28 user nova-compute[72780]: WARNING nova.compute.manager [req-03bc520a-d869-4346-9cc6-4e1d1a89d193 req-2f745188-9ac1-4c76-9d7d-354432d238d1 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state active and task_state None.
Aug 09 01:21:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d1aecc13-180b-415d-b0b4-d6f9106a8f84 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.071s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:21:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:21:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:21:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:40 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:46 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:21:46 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8101MB free_disk=24.984886169433594GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 13b7263c-2f83-4bb6-8459-133e93acba6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:21:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:21:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:21:59 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:21:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'flavor' on Instance uuid eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:16 user nova-compute[72780]: INFO nova.compute.manager [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Attaching volume 6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c to /dev/vdb
Aug 09 01:22:16 user nova-compute[72780]: DEBUG os_brick.utils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f69b48-cdd3-44b5-a19d-466b86bc0c9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649b458-80db-4a7a-a866-8b8957e92034]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c20ae-5926-4c1a-8db3-f653798eda1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df519545-9b2c-4de6-a952-6e264548a369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:22:16 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:22:16 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e27235-6f60-4103-884a-3f07449fae68]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG os_brick.utils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:22:16 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating existing volume attachment record: 56f98dc1-44e4-4695-a18f-925849b9404b {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:22:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpfbecPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:22:24 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:22:24 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:22:24 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f85b75-eec1-42dc-bd5d-ebe2174eeed9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:22:24 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c8a4ce-379e-4263-9b32-a46f8c2a1cf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c] added
Aug 09 01:22:24 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56762a18-63f2-4ce4-b9a7-cf59a74a61c6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[da79772a-57c3-43ce-b2ba-0d9a094111cd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpfbecPT {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpfbecPT" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae24c7b6-af18-4c6b-86cd-c9855becfe4d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SpfbecPT'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea079a0-e99c-4016-858f-586a794196ec]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1521c2a0-bc6d-4e7b-a3a9-fd92fc4dda12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:22:24 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:22:24 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:22:24 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:22:24 user nova-compute[72780]: 
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b12ad28-d763-4029-9add-15dcaa13bbc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260]
Aug 09 01:22:24 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260] successful.
Aug 09 01:22:24 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a944f-9447-45b2-a38c-a56f5d5d1288]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d17996-3749-406e-9af4-0a7c673104a6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:22:24 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:22:24 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[47821f29-1eb3-4fe3-953f-cd903b24364a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpfbecPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:22:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:22:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23636343565366530', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:22:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636343565366530', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:22:25 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'flavor' on Instance uuid eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:22:25 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:22:25 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:22:25 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:22:25 user nova-compute[72780]:   <serial>6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c</serial>
Aug 09 01:22:25 user nova-compute[72780]: </disk>
Aug 09 01:22:25 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:22:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:22:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:22:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] No VIF found with MAC fa:16:3e:42:36:6b, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:22:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6cafbf91-eae1-43d0-b66b-70eb667668f5 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.806s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing instance network info cache due to event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updated VIF entry in instance network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-8309c2ea-3706-4112-809c-514be344fff3 req-7c8d733a-c77a-49f8-8aff-0163d7b3efcf service nova] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:22:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing instance network info cache due to event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:31 user nova-compute[72780]: INFO nova.compute.manager [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Rebooting instance
Aug 09 01:22:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG nova.network.neutron [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updated VIF entry in instance network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG nova.network.neutron [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fea0f76d-a28a-44c9-8237-401c663a3694 req-3fce987b-373a-40b4-881a-53ee41e9a4b1 service nova] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG nova.network.neutron [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:22:32 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.compute.manager [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing instance network info cache due to event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'flavor' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updated VIF entry in instance network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.network.neutron [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:33 user nova-compute[72780]: INFO nova.compute.manager [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Attaching volume 4ab0f459-0077-4489-b424-00159538f6ce to /dev/vdb
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-73d0ecaf-528a-4af2-a7fe-60ca9b9bdd82 req-f1a363ab-963d-4dd3-abe0-dff926f5111b service nova] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG os_brick.utils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce1f77f-e9b5-40a2-a3c0-685b05835280]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21d41ad-7cfe-4cf9-ba67-d2951126ee21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d208a5-c970-4c0a-805c-e084f69e1a4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334c554-e06a-4456-9d70-3a2dd5f8e042]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:22:33 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:22:33 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[118519b2-8689-480e-9e4e-7a8d0c4b00c4]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG os_brick.utils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:22:33 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating existing volume attachment record: e1c1b312-f218-41fb-be56-c3e38e939735 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d4a6cca-55fb-4898-ae6c-dd94bfe94d98 req-24beb0f1-114f-492e-afbc-65be90c173bc service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-unplugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d4a6cca-55fb-4898-ae6c-dd94bfe94d98 req-24beb0f1-114f-492e-afbc-65be90c173bc service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d4a6cca-55fb-4898-ae6c-dd94bfe94d98 req-24beb0f1-114f-492e-afbc-65be90c173bc service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6d4a6cca-55fb-4898-ae6c-dd94bfe94d98 req-24beb0f1-114f-492e-afbc-65be90c173bc service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-6d4a6cca-55fb-4898-ae6c-dd94bfe94d98 req-24beb0f1-114f-492e-afbc-65be90c173bc service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-unplugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:35 user nova-compute[72780]: WARNING nova.compute.manager [req-6d4a6cca-55fb-4898-ae6c-dd94bfe94d98 req-24beb0f1-114f-492e-afbc-65be90c173bc service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-unplugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state active and task_state reboot_started.
Aug 09 01:22:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance shutdown successfully.
Aug 09 01:22:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-2b17e1c7-e6af-4908-808e-34424aea9f19 req-f1a4753d-0ae9-4ffc-9864-1e93671ecfc6 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b17e1c7-e6af-4908-808e-34424aea9f19 req-f1a4753d-0ae9-4ffc-9864-1e93671ecfc6 service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b17e1c7-e6af-4908-808e-34424aea9f19 req-f1a4753d-0ae9-4ffc-9864-1e93671ecfc6 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-2b17e1c7-e6af-4908-808e-34424aea9f19 req-f1a4753d-0ae9-4ffc-9864-1e93671ecfc6 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-2b17e1c7-e6af-4908-808e-34424aea9f19 req-f1a4753d-0ae9-4ffc-9864-1e93671ecfc6 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:37 user nova-compute[72780]: WARNING nova.compute.manager [req-2b17e1c7-e6af-4908-808e-34424aea9f19 req-f1a4753d-0ae9-4ffc-9864-1e93671ecfc6 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state active and task_state reboot_started.
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:39 user nova-compute[72780]: WARNING nova.compute.manager [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state active and task_state reboot_started.
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:39 user nova-compute[72780]: WARNING nova.compute.manager [req-1d046b08-b3d3-49ca-b889-27703e8c4500 req-d1f985ec-1576-43c4-9d15-5f80a8e83db5 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state active and task_state reboot_started.
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544159.4812179, eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:22:39 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] VM Resumed (Lifecycle Event)
Aug 09 01:22:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance running successfully.
Aug 09 01:22:39 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance soft rebooted successfully.
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:22:39 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544159.4840496, eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:22:39 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] VM Started (Lifecycle Event)
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5c3009cb-d1f8-4b2d-bba5-ff3672505cf8 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.904s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:22:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUpWYwLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:22:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:22:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:22:42 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc0108d-a34f-4f72-a7c8-9fdfbf9229f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:22:42 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ff1ec8-75ac-4511-b1f6-23fce810a972]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce] added
Aug 09 01:22:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[16329fdc-f4a8-46b7-b31b-09732347f6d4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d38bad6-c72d-4124-8ed8-78fc8a95221e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUpWYwLB {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUpWYwLB" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6a7606-2cc1-4889-a5bf-d26ffc1f49fe]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUpWYwLB'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23f819c-f1de-4fa3-ad3c-bfab4c688efc]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c77c9e-bfd5-4350-ba49-abaf24089f88]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:22:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:22:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2c4375-f381-43e5-8cb6-1e4e724d35f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260]
Aug 09 01:22:43 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260] successful.
Aug 09 01:22:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d5ef6-a98b-4258-88f9-913d8c044298]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[433645b9-930e-432e-8d20-d7d2d14eac40]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:22:43 user nova-compute[72780]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:22:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:22:43 user nova-compute[72780]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:22:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbee48d-3b49-499c-8139-cdcd9ece2aaa]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:22:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUpWYwLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23937373030656662', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937373030656662', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG nova.objects.instance [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'flavor' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:22:44 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:22:44 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:22:44 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:22:44 user nova-compute[72780]:   <serial>4ab0f459-0077-4489-b424-00159538f6ce</serial>
Aug 09 01:22:44 user nova-compute[72780]: </disk>
Aug 09 01:22:44 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:b2:e5:e8, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:22:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-6c7cbaf4-362f-4282-9d38-9d0768a042f8 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.151s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:45 user nova-compute[72780]: INFO nova.compute.manager [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Rescuing
Aug 09 01:22:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:22:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:22:45 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG nova.network.neutron [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-61f245c2-ed81-47ed-884f-8bc6f205d540 req-8bbd78c5-34cd-40f0-a1d1-f14401a20a2d service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61f245c2-ed81-47ed-884f-8bc6f205d540 req-8bbd78c5-34cd-40f0-a1d1-f14401a20a2d service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61f245c2-ed81-47ed-884f-8bc6f205d540 req-8bbd78c5-34cd-40f0-a1d1-f14401a20a2d service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-61f245c2-ed81-47ed-884f-8bc6f205d540 req-8bbd78c5-34cd-40f0-a1d1-f14401a20a2d service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:46 user nova-compute[72780]: DEBUG nova.compute.manager [req-61f245c2-ed81-47ed-884f-8bc6f205d540 req-8bbd78c5-34cd-40f0-a1d1-f14401a20a2d service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:46 user nova-compute[72780]: WARNING nova.compute.manager [req-61f245c2-ed81-47ed-884f-8bc6f205d540 req-8bbd78c5-34cd-40f0-a1d1-f14401a20a2d service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state active and task_state rescuing.
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance destroyed successfully.
Aug 09 01:22:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Attempting rescue
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72780) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance directory exists: not creating {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 01:22:47 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Creating image(s)
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue" returned: 0 in 0.053s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'migration_context' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Start _get_guest_xml network_info=[{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:b2:e5:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'resources' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'numa_topology' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:47 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:22:47 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:22:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516536775',display_name='tempest-ServerRescueNegativeTestJSON-server-1516536775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516536775',id=48,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKu0i3FnQRZtx4XRq4/FdFbFeX7zEePWtu9dZo+Kz046V5fxY3Naf1dzy8LQVIfdH7jVg9QIP1LQc3ozYndIRXEXi2QuUsVADIpF4FOvOVNpKpWTKKAsoeFs0NxUm/gFg==',key_name='tempest-keypair-2084992097',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ymoavt3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59257e56086046b0a27ce3880c309586',uuid=d4532a1e-2830-4e60-9134-c9a34eec0d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:b2:e5:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "vif_mac": "fa:16:3e:b2:e5:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'pci_devices' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:22:48 user nova-compute[72780]:   <uuid>d4532a1e-2830-4e60-9134-c9a34eec0d23</uuid>
Aug 09 01:22:48 user nova-compute[72780]:   <name>instance-00000030</name>
Aug 09 01:22:48 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:22:48 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:22:48 user nova-compute[72780]:   <metadata>
Aug 09 01:22:48 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:22:48 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:22:48 user nova-compute[72780]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1516536775</nova:name>
Aug 09 01:22:48 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:22:47</nova:creationTime>
Aug 09 01:22:48 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:22:48 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:22:48 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:22:48 user nova-compute[72780]:       <nova:owner>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:user uuid="59257e56086046b0a27ce3880c309586">tempest-ServerRescueNegativeTestJSON-1588572554-project-member</nova:user>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:project uuid="b9784ac1238a41e598ec36907111c770">tempest-ServerRescueNegativeTestJSON-1588572554</nova:project>
Aug 09 01:22:48 user nova-compute[72780]:       </nova:owner>
Aug 09 01:22:48 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:22:48 user nova-compute[72780]:       <nova:ports>
Aug 09 01:22:48 user nova-compute[72780]:         <nova:port uuid="937fd312-f2e3-4cde-94a1-5a259c56d803">
Aug 09 01:22:48 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:22:48 user nova-compute[72780]:         </nova:port>
Aug 09 01:22:48 user nova-compute[72780]:       </nova:ports>
Aug 09 01:22:48 user nova-compute[72780]:     </nova:instance>
Aug 09 01:22:48 user nova-compute[72780]:   </metadata>
Aug 09 01:22:48 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:22:48 user nova-compute[72780]:     <system>
Aug 09 01:22:48 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:22:48 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:22:48 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:22:48 user nova-compute[72780]:       <entry name="serial">d4532a1e-2830-4e60-9134-c9a34eec0d23</entry>
Aug 09 01:22:48 user nova-compute[72780]:       <entry name="uuid">d4532a1e-2830-4e60-9134-c9a34eec0d23</entry>
Aug 09 01:22:48 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:22:48 user nova-compute[72780]:     </system>
Aug 09 01:22:48 user nova-compute[72780]:   </sysinfo>
Aug 09 01:22:48 user nova-compute[72780]:   <os>
Aug 09 01:22:48 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:22:48 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:22:48 user nova-compute[72780]:   </os>
Aug 09 01:22:48 user nova-compute[72780]:   <features>
Aug 09 01:22:48 user nova-compute[72780]:     <acpi/>
Aug 09 01:22:48 user nova-compute[72780]:     <apic/>
Aug 09 01:22:48 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:22:48 user nova-compute[72780]:   </features>
Aug 09 01:22:48 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:22:48 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:22:48 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:22:48 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:22:48 user nova-compute[72780]:   </clock>
Aug 09 01:22:48 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:22:48 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:22:48 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:22:48 user nova-compute[72780]:   </cpu>
Aug 09 01:22:48 user nova-compute[72780]:   <devices>
Aug 09 01:22:48 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:22:48 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:22:48 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue"/>
Aug 09 01:22:48 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:22:48 user nova-compute[72780]:     </disk>
Aug 09 01:22:48 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:22:48 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:22:48 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk"/>
Aug 09 01:22:48 user nova-compute[72780]:       <target dev="vdb" bus="virtio"/>
Aug 09 01:22:48 user nova-compute[72780]:     </disk>
Aug 09 01:22:48 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:22:48 user nova-compute[72780]:       <mac address="fa:16:3e:b2:e5:e8"/>
Aug 09 01:22:48 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:22:48 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:22:48 user nova-compute[72780]:       <target dev="tap937fd312-f2"/>
Aug 09 01:22:48 user nova-compute[72780]:     </interface>
Aug 09 01:22:48 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:22:48 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/console.log" append="off"/>
Aug 09 01:22:48 user nova-compute[72780]:     </serial>
Aug 09 01:22:48 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:22:48 user nova-compute[72780]:     <video>
Aug 09 01:22:48 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:22:48 user nova-compute[72780]:     </video>
Aug 09 01:22:48 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:22:48 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:22:48 user nova-compute[72780]:     </rng>
Aug 09 01:22:48 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:22:48 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:22:48 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:22:48 user nova-compute[72780]:     </memballoon>
Aug 09 01:22:48 user nova-compute[72780]:   </devices>
Aug 09 01:22:48 user nova-compute[72780]: </domain>
Aug 09 01:22:48 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:22:48 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance destroyed successfully.
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] No VIF found with MAC fa:16:3e:b2:e5:e8, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:22:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-9841c56c-ac0a-4269-b842-24a2277c0100 req-6d61f25d-cfb4-4ea4-8c4f-28477005ebe6 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9841c56c-ac0a-4269-b842-24a2277c0100 req-6d61f25d-cfb4-4ea4-8c4f-28477005ebe6 service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9841c56c-ac0a-4269-b842-24a2277c0100 req-6d61f25d-cfb4-4ea4-8c4f-28477005ebe6 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9841c56c-ac0a-4269-b842-24a2277c0100 req-6d61f25d-cfb4-4ea4-8c4f-28477005ebe6 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-9841c56c-ac0a-4269-b842-24a2277c0100 req-6d61f25d-cfb4-4ea4-8c4f-28477005ebe6 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:52 user nova-compute[72780]: WARNING nova.compute.manager [req-9841c56c-ac0a-4269-b842-24a2277c0100 req-6d61f25d-cfb4-4ea4-8c4f-28477005ebe6 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state active and task_state rescuing.
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:52 user nova-compute[72780]: WARNING nova.compute.manager [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state active and task_state rescuing.
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:22:52 user nova-compute[72780]: WARNING nova.compute.manager [req-3898c405-59fe-43b3-be7e-cb5738993048 req-2fcfd5ef-8578-451e-9753-8842f61565da service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state active and task_state rescuing.
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for d4532a1e-2830-4e60-9134-c9a34eec0d23 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544172.0660963, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:22:52 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Resumed (Lifecycle Event)
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-4bf95bf4-28c2-4f6a-9f75-1e8c1c075eba tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:22:52 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:22:52 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8280MB free_disk=24.979679107666016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:22:52 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544172.0664654, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:22:52 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Started (Lifecycle Event)
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 13b7263c-2f83-4bb6-8459-133e93acba6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:22:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:22:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:22:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:04 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:23:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:23:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:23:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing instance network info cache due to event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:23:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:23:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:23:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:23:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updated VIF entry in instance network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:23:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:23:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3ecdeffb-f476-4334-8135-65ae3bd9e6ac req-1c8813d8-edc4-48eb-a623-f3c433c0fdf6 service nova] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:23:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:23:18 user nova-compute[72780]: INFO nova.compute.manager [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Shelving
Aug 09 01:23:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-441d45c1-01ec-4d3f-88d8-b342ecedb66b req-70c08de3-2498-436e-b4d8-e0a1bbae0c08 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-unplugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-441d45c1-01ec-4d3f-88d8-b342ecedb66b req-70c08de3-2498-436e-b4d8-e0a1bbae0c08 service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-441d45c1-01ec-4d3f-88d8-b342ecedb66b req-70c08de3-2498-436e-b4d8-e0a1bbae0c08 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-441d45c1-01ec-4d3f-88d8-b342ecedb66b req-70c08de3-2498-436e-b4d8-e0a1bbae0c08 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:23:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-441d45c1-01ec-4d3f-88d8-b342ecedb66b req-70c08de3-2498-436e-b4d8-e0a1bbae0c08 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-unplugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:23:18 user nova-compute[72780]: WARNING nova.compute.manager [req-441d45c1-01ec-4d3f-88d8-b342ecedb66b req-70c08de3-2498-436e-b4d8-e0a1bbae0c08 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-unplugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state active and task_state shelving.
Aug 09 01:23:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance destroyed successfully.
Aug 09 01:23:19 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Beginning cold snapshot process
Aug 09 01:23:19 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:23:19 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk /opt/stack/data/nova/instances/snapshots/tmpi19n8xy6/6c458b545a654490b940f8403e71a1a7 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk /opt/stack/data/nova/instances/snapshots/tmpi19n8xy6/6c458b545a654490b940f8403e71a1a7" returned: 0 in 0.794s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:20 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Snapshot extracted, beginning image upload
Aug 09 01:23:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-74267785-7c9e-47b5-95b3-bab54242d2c2 req-56e5bcc5-3a77-48df-b66c-51eb6483c336 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:23:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-74267785-7c9e-47b5-95b3-bab54242d2c2 req-56e5bcc5-3a77-48df-b66c-51eb6483c336 service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:23:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-74267785-7c9e-47b5-95b3-bab54242d2c2 req-56e5bcc5-3a77-48df-b66c-51eb6483c336 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:23:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-74267785-7c9e-47b5-95b3-bab54242d2c2 req-56e5bcc5-3a77-48df-b66c-51eb6483c336 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:23:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-74267785-7c9e-47b5-95b3-bab54242d2c2 req-56e5bcc5-3a77-48df-b66c-51eb6483c336 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:23:21 user nova-compute[72780]: WARNING nova.compute.manager [req-74267785-7c9e-47b5-95b3-bab54242d2c2 req-56e5bcc5-3a77-48df-b66c-51eb6483c336 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 01:23:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Snapshot image upload complete
Aug 09 01:23:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:23:22 user nova-compute[72780]: INFO nova.compute.manager [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Shelve offloading
Aug 09 01:23:22 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance destroyed successfully.
Aug 09 01:23:22 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:23:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:23:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:23:22 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:23:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance destroyed successfully.
Aug 09 01:23:23 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'resources' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437117913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437117913',id=49,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgviTv0o/AypdKIzucSq4Y2dL8AuAU/IhSawBkn0h6wtkTZ+gOPrH+m2nS8GLC7LRjrYX5giVN2QlVJwJkCINTEsJv8+uUE3Xd7jK/jFL8f+5cdX00HNuziGyFxPow5Ag==',key_name='tempest-keypair-1605457411',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-qgeuxdhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member',shelved_at='2023-08-09T01:23:22.769942',shelved_host='user',shelved_image_id='9c8f99ef-415f-4a1a-abdb-8957b5e88a76'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:23:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=13b7263c-2f83-4bb6-8459-133e93acba6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG os_vif [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb218b39d-45, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:23:23 user nova-compute[72780]: INFO os_vif [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45')
Aug 09 01:23:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Deleting instance files /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e_del
Aug 09 01:23:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Deletion of /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e_del complete
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing instance network info cache due to event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:23:24 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Deleted allocations for instance 13b7263c-2f83-4bb6-8459-133e93acba6e
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'numa_topology' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0bccf7c0-6c77-4632-959a-239ead94e8a5 tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.819s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updated VIF entry in instance network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb218b39d-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:23:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-22aac9e8-52a1-4775-a26b-f3ea01058f0e req-27880831-087e-4153-b123-27243d4b429b service nova] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:23:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:30 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:23:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:34 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544199.2261615, 13b7263c-2f83-4bb6-8459-133e93acba6e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:23:34 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] VM Stopped (Lifecycle Event)
Aug 09 01:23:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-b02acd9e-075f-4fdc-8aa8-c7937f8961af None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:23:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:23:40 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:23:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:47 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:23:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:49 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:23:49 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=24.94747543334961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:23:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:23:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:23:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:12 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:24:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:12 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:24:12 user nova-compute[72780]: INFO nova.compute.claims [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Claim successful on node user
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:24:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.policy [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a4415483828447e847c9da37a629887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b6f0d8351a429db3e9d429cac313bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:24:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Creating image(s)
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "/opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "/opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "/opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.129s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.129s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk 1073741824" returned: 0 in 0.047s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.127s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:24:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Cannot resize image /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.objects.instance [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'migration_context' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Ensure instance console log exists: /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Successfully created port: a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Successfully updated port: a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquired lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-changed-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Refreshing instance network info cache due to event network-changed-a7ab7086-4000-43ad-92f0-0967bead9f80. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] Acquiring lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:24:14 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.neutron [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Releasing lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Instance network_info: |[{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] Acquired lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Refreshing network info cache for port a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Start _get_guest_xml network_info=[{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:24:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:24:15 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1294358660',display_name='tempest-SnapshotDataIntegrityTests-server-1294358660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1294358660',id=50,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrr/Kk9PkFRg/sPNeNkmbKXojl5FUDR6yT9RwDVRE0EmtAJmonKHyeQ1HK/+lLxJtaOY0NqvBM0dNQnEMgc5KJczgTNxmd906aVOTe2OT+bAif5X6QisImGUAEMNgjLhw==',key_name='tempest-keypair-732572729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9b6f0d8351a429db3e9d429cac313bb',ramdisk_id='',reservation_id='r-0qn247jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1082386859',owner_user_name='tempest-SnapshotDataIntegrityTests-1082386859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a4415483828447e847c9da37a629887',uuid=07e29db5-d679-4196-9e76-1388d7466565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Converting VIF {"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.objects.instance [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'pci_devices' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:24:15 user nova-compute[72780]:   <uuid>07e29db5-d679-4196-9e76-1388d7466565</uuid>
Aug 09 01:24:15 user nova-compute[72780]:   <name>instance-00000032</name>
Aug 09 01:24:15 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:24:15 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:24:15 user nova-compute[72780]:   <metadata>
Aug 09 01:24:15 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:24:15 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:24:15 user nova-compute[72780]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1294358660</nova:name>
Aug 09 01:24:15 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:24:15</nova:creationTime>
Aug 09 01:24:15 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:24:15 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:24:15 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:24:15 user nova-compute[72780]:       <nova:owner>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:user uuid="9a4415483828447e847c9da37a629887">tempest-SnapshotDataIntegrityTests-1082386859-project-member</nova:user>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:project uuid="d9b6f0d8351a429db3e9d429cac313bb">tempest-SnapshotDataIntegrityTests-1082386859</nova:project>
Aug 09 01:24:15 user nova-compute[72780]:       </nova:owner>
Aug 09 01:24:15 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:24:15 user nova-compute[72780]:       <nova:ports>
Aug 09 01:24:15 user nova-compute[72780]:         <nova:port uuid="a7ab7086-4000-43ad-92f0-0967bead9f80">
Aug 09 01:24:15 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 01:24:15 user nova-compute[72780]:         </nova:port>
Aug 09 01:24:15 user nova-compute[72780]:       </nova:ports>
Aug 09 01:24:15 user nova-compute[72780]:     </nova:instance>
Aug 09 01:24:15 user nova-compute[72780]:   </metadata>
Aug 09 01:24:15 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:24:15 user nova-compute[72780]:     <system>
Aug 09 01:24:15 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:24:15 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:24:15 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:24:15 user nova-compute[72780]:       <entry name="serial">07e29db5-d679-4196-9e76-1388d7466565</entry>
Aug 09 01:24:15 user nova-compute[72780]:       <entry name="uuid">07e29db5-d679-4196-9e76-1388d7466565</entry>
Aug 09 01:24:15 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:24:15 user nova-compute[72780]:     </system>
Aug 09 01:24:15 user nova-compute[72780]:   </sysinfo>
Aug 09 01:24:15 user nova-compute[72780]:   <os>
Aug 09 01:24:15 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:24:15 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:24:15 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:24:15 user nova-compute[72780]:   </os>
Aug 09 01:24:15 user nova-compute[72780]:   <features>
Aug 09 01:24:15 user nova-compute[72780]:     <acpi/>
Aug 09 01:24:15 user nova-compute[72780]:     <apic/>
Aug 09 01:24:15 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:24:15 user nova-compute[72780]:   </features>
Aug 09 01:24:15 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:24:15 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:24:15 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:24:15 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:24:15 user nova-compute[72780]:   </clock>
Aug 09 01:24:15 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:24:15 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:24:15 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:24:15 user nova-compute[72780]:   </cpu>
Aug 09 01:24:15 user nova-compute[72780]:   <devices>
Aug 09 01:24:15 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:24:15 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:24:15 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk"/>
Aug 09 01:24:15 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:24:15 user nova-compute[72780]:     </disk>
Aug 09 01:24:15 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:24:15 user nova-compute[72780]:       <mac address="fa:16:3e:92:5b:f3"/>
Aug 09 01:24:15 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:24:15 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:24:15 user nova-compute[72780]:       <target dev="tapa7ab7086-40"/>
Aug 09 01:24:15 user nova-compute[72780]:     </interface>
Aug 09 01:24:15 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:24:15 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/console.log" append="off"/>
Aug 09 01:24:15 user nova-compute[72780]:     </serial>
Aug 09 01:24:15 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:24:15 user nova-compute[72780]:     <video>
Aug 09 01:24:15 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:24:15 user nova-compute[72780]:     </video>
Aug 09 01:24:15 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:24:15 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:24:15 user nova-compute[72780]:     </rng>
Aug 09 01:24:15 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:24:15 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:24:15 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:24:15 user nova-compute[72780]:     </memballoon>
Aug 09 01:24:15 user nova-compute[72780]:   </devices>
Aug 09 01:24:15 user nova-compute[72780]: </domain>
Aug 09 01:24:15 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1294358660',display_name='tempest-SnapshotDataIntegrityTests-server-1294358660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1294358660',id=50,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrr/Kk9PkFRg/sPNeNkmbKXojl5FUDR6yT9RwDVRE0EmtAJmonKHyeQ1HK/+lLxJtaOY0NqvBM0dNQnEMgc5KJczgTNxmd906aVOTe2OT+bAif5X6QisImGUAEMNgjLhw==',key_name='tempest-keypair-732572729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9b6f0d8351a429db3e9d429cac313bb',ramdisk_id='',reservation_id='r-0qn247jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1082386859',owner_user_name='tempest-SnapshotDataIntegrityTests-1082386859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a4415483828447e847c9da37a629887',uuid=07e29db5-d679-4196-9e76-1388d7466565,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Converting VIF {"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG os_vif [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7ab7086-40, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7ab7086-40, col_values=(('external_ids', {'iface-id': 'a7ab7086-4000-43ad-92f0-0967bead9f80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:5b:f3', 'vm-uuid': '07e29db5-d679-4196-9e76-1388d7466565'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:24:15 user nova-compute[72780]: INFO os_vif [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40')
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No VIF found with MAC fa:16:3e:92:5b:f3, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updated VIF entry in instance network info cache for port a7ab7086-4000-43ad-92f0-0967bead9f80. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:24:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c897e0d9-6b41-4e96-a1f5-c579274159a6 req-36f60ad9-deb4-4f49-aa3a-e8feed0ff40e service nova] Releasing lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:24:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-d98f5463-bc5e-4b01-8666-1448c1aa667a req-6081f71f-10b2-4743-954d-798fdc7663c3 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d98f5463-bc5e-4b01-8666-1448c1aa667a req-6081f71f-10b2-4743-954d-798fdc7663c3 service nova] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d98f5463-bc5e-4b01-8666-1448c1aa667a req-6081f71f-10b2-4743-954d-798fdc7663c3 service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d98f5463-bc5e-4b01-8666-1448c1aa667a req-6081f71f-10b2-4743-954d-798fdc7663c3 service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG nova.compute.manager [req-d98f5463-bc5e-4b01-8666-1448c1aa667a req-6081f71f-10b2-4743-954d-798fdc7663c3 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] No waiting events found dispatching network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:24:17 user nova-compute[72780]: WARNING nova.compute.manager [req-d98f5463-bc5e-4b01-8666-1448c1aa667a req-6081f71f-10b2-4743-954d-798fdc7663c3 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received unexpected event network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 for instance with vm_state building and task_state spawning.
Aug 09 01:24:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544258.9337268, 07e29db5-d679-4196-9e76-1388d7466565 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:24:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] VM Resumed (Lifecycle Event)
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:24:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Instance spawned successfully.
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:24:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:24:18 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544258.9354286, 07e29db5-d679-4196-9e76-1388d7466565 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:24:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] VM Started (Lifecycle Event)
Aug 09 01:24:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:24:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:24:19 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:24:19 user nova-compute[72780]: INFO nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 09 01:24:19 user nova-compute[72780]: DEBUG nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:24:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-06ac666b-ffb7-4d92-b8be-343af821caaa req-fca5bf56-1644-4396-9b4f-1960117ebe8a service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-06ac666b-ffb7-4d92-b8be-343af821caaa req-fca5bf56-1644-4396-9b4f-1960117ebe8a service nova] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-06ac666b-ffb7-4d92-b8be-343af821caaa req-fca5bf56-1644-4396-9b4f-1960117ebe8a service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-06ac666b-ffb7-4d92-b8be-343af821caaa req-fca5bf56-1644-4396-9b4f-1960117ebe8a service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-06ac666b-ffb7-4d92-b8be-343af821caaa req-fca5bf56-1644-4396-9b4f-1960117ebe8a service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] No waiting events found dispatching network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:24:19 user nova-compute[72780]: WARNING nova.compute.manager [req-06ac666b-ffb7-4d92-b8be-343af821caaa req-fca5bf56-1644-4396-9b4f-1960117ebe8a service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received unexpected event network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 for instance with vm_state building and task_state spawning.
Aug 09 01:24:19 user nova-compute[72780]: INFO nova.compute.manager [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Took 6.22 seconds to build instance.
Aug 09 01:24:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-cff6e5f6-4000-47c8-bbf1-6d66cb8140da tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.314s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing instance network info cache due to event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:24:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:24:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:24:23 user nova-compute[72780]: DEBUG nova.network.neutron [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updated VIF entry in instance network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-32f95d94-c170-4140-8497-eb8cb6fbaa9d req-b2430885-2687-43f0-825d-0f7acd57f939 service nova] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing instance network info cache due to event network-changed-1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] Acquiring lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] Acquired lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG nova.network.neutron [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Refreshing network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:24 user nova-compute[72780]: INFO nova.compute.manager [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Detaching volume 6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c
Aug 09 01:24:25 user nova-compute[72780]: INFO nova.virt.block_device [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Attempting to driver detach volume 6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c from mountpoint /dev/vdb
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Attempting to detach device vdb from instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:24:25 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:24:25 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:24:25 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:24:25 user nova-compute[72780]:   <serial>6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c</serial>
Aug 09 01:24:25 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:24:25 user nova-compute[72780]: </disk>
Aug 09 01:24:25 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:24:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully detached device vdb from instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 from the persistent domain config.
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:24:25 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:24:25 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:24:25 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:24:25 user nova-compute[72780]:   <serial>6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c</serial>
Aug 09 01:24:25 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:24:25 user nova-compute[72780]: </disk>
Aug 09 01:24:25 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.network.neutron [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updated VIF entry in instance network info cache for port 1e78b117-43ae-4196-a94f-4ff4ab95139e. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.network.neutron [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [{"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-76bb3e46-7434-44be-a91c-390a52a9437d req-ba644f3c-c755-4cf5-8e06-d7029038ac49 service nova] Releasing lock "refresh_cache-eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544265.539159, eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:24:25 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully detached device vdb from instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 from the live domain config.
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpfbecPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:24:25 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a5929-43cf-4543-83af-e5f7f9fd841d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f785f9d3-3a5f-4522-9fb6-9fefeddacd5e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:24:25 user nova-compute[72780]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:24:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c (non-flash)
Aug 09 01:24:25 user nova-compute[72780]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:24:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06b8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1427cbd8-1ba4-4ec3-8ac9-608042b83521]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348ec69-47fa-4bef-b2e7-9a4236cf3f42]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b805d-566b-437f-9f55-7039ac4bcd5e]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[19155723-3ef8-4f65-9be2-5b6c02c55533]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d7db0-c946-4179-8c8b-bdbdcbbf4c69]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bab23e-c70b-40a3-bbc9-80c5aa43ed5d]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260]
Aug 09 01:24:25 user nova-compute[72780]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c, portal: 172.16.0.220,3260] successful.
Aug 09 01:24:25 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd3bfd4-8b77-4f0e-81f3-6f1ca342f82c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eab9f84-1f1e-4c89-add3-c6ba29d27f2a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] <== disconnect_volume: return (294ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:24:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:24:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'flavor' on Instance uuid eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:24:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3a4bc057-0428-45dc-b2ce-7bbd001b3deb tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.761s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:24:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:24:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:37 user nova-compute[72780]: INFO nova.compute.manager [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Unrescuing
Aug 09 01:24:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG nova.network.neutron [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG nova.network.neutron [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG nova.objects.instance [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'flavor' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-22df42fd-0664-47dc-bb1f-ab298a72f0c9 req-8de54818-25ce-4c17-84fa-ee8579eb6271 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-22df42fd-0664-47dc-bb1f-ab298a72f0c9 req-8de54818-25ce-4c17-84fa-ee8579eb6271 service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-22df42fd-0664-47dc-bb1f-ab298a72f0c9 req-8de54818-25ce-4c17-84fa-ee8579eb6271 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-22df42fd-0664-47dc-bb1f-ab298a72f0c9 req-8de54818-25ce-4c17-84fa-ee8579eb6271 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:38 user nova-compute[72780]: DEBUG nova.compute.manager [req-22df42fd-0664-47dc-bb1f-ab298a72f0c9 req-8de54818-25ce-4c17-84fa-ee8579eb6271 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:24:38 user nova-compute[72780]: WARNING nova.compute.manager [req-22df42fd-0664-47dc-bb1f-ab298a72f0c9 req-8de54818-25ce-4c17-84fa-ee8579eb6271 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:24:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance destroyed successfully.
Aug 09 01:24:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:24:40 user nova-compute[72780]: WARNING nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:24:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:24:40 user nova-compute[72780]: WARNING nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:24:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:40 user nova-compute[72780]: DEBUG nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:24:40 user nova-compute[72780]: WARNING nova.compute.manager [req-7ea1c0f6-698c-403e-9f65-5304c2401062 req-5e9f5bbf-c98d-4ee1-a92c-13b53b75a9ec service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state rescued and task_state unrescuing.
Aug 09 01:24:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Removed pending event for d4532a1e-2830-4e60-9134-c9a34eec0d23 due to event {{(pid=72780) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544281.748664, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:24:41 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Resumed (Lifecycle Event)
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-28430cbd-67d9-4dbc-86bf-b6c05ce8ed86 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:24:41 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544281.7490304, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:24:41 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Started (Lifecycle Event)
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:24:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:24:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:48 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:24:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:24:50 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:24:50 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8116MB free_disk=24.908344268798828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:24:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:24:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:24:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:11 user nova-compute[72780]: INFO nova.compute.manager [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Unshelving
Aug 09 01:25:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG nova.objects.instance [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'pci_requests' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG nova.objects.instance [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'numa_topology' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:25:11 user nova-compute[72780]: INFO nova.compute.claims [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Claim successful on node user
Aug 09 01:25:11 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:11 user nova-compute[72780]: INFO nova.network.neutron [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating port b218b39d-459e-4b92-87a2-cdf5233b5324 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 01:25:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.compute.manager [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing instance network info cache due to event network-changed-b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] Acquiring lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.network.neutron [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:25:12 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Creating image(s)
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.objects.instance [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] Acquired lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG nova.network.neutron [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Refreshing network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "a891261a9fffd72c56813882dcd403c81972c1d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:12 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "a891261a9fffd72c56813882dcd403c81972c1d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.part --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.part --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG nova.virt.images [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] 9c8f99ef-415f-4a1a-abdb-8957b5e88a76 was qcow2, converting to raw {{(pid=72780) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG nova.privsep.utils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72780) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.part /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.converted {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updated VIF entry in instance network info cache for port b218b39d-459e-4b92-87a2-cdf5233b5324. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-28ab4902-db5d-466d-be54-db0b2609bf68 req-fd01c794-cc52-4c49-b1c4-76c3c7262a46 service nova] Releasing lock "refresh_cache-13b7263c-2f83-4bb6-8459-133e93acba6e" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.part /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.converted" returned: 0 in 0.570s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.converted --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "a891261a9fffd72c56813882dcd403c81972c1d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.947s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 --force-share --output=json" returned: 0 in 0.131s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "a891261a9fffd72c56813882dcd403c81972c1d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "a891261a9fffd72c56813882dcd403c81972c1d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:14 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6,backing_fmt=raw /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6,backing_fmt=raw /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk 1073741824" returned: 0 in 0.054s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "a891261a9fffd72c56813882dcd403c81972c1d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG nova.objects.instance [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'migration_context' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:15 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Rebasing disk image.
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.149s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 -F raw /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 -F raw /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk" returned: 0 in 2.051s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Ensure instance console log exists: /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Start _get_guest_xml network_info=[{"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='596a741993f91444b8ee8e0fdcd5a867',container_format='bare',created_at=2023-08-09T01:23:18Z,direct_url=<?>,disk_format='qcow2',id=9c8f99ef-415f-4a1a-abdb-8957b5e88a76,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-437117913-shelved',owner='9dd3451d1fb641ad8106f8b4bcb68fc1',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T01:23:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:25:17 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:25:17 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='596a741993f91444b8ee8e0fdcd5a867',container_format='bare',created_at=2023-08-09T01:23:18Z,direct_url=<?>,disk_format='qcow2',id=9c8f99ef-415f-4a1a-abdb-8957b5e88a76,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-437117913-shelved',owner='9dd3451d1fb641ad8106f8b4bcb68fc1',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T01:23:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.objects.instance [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437117913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437117913',id=49,image_ref='9c8f99ef-415f-4a1a-abdb-8957b5e88a76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1605457411',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-qgeuxdhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member',shelved_at='2023-08-09T01:23:22.769942',shelved_host='user',shelved_image_id='9c8f99ef-415f-4a1a-abdb-8957b5e88a76'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=13b7263c-2f83-4bb6-8459-133e93acba6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.objects.instance [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'pci_devices' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:25:17 user nova-compute[72780]:   <uuid>13b7263c-2f83-4bb6-8459-133e93acba6e</uuid>
Aug 09 01:25:17 user nova-compute[72780]:   <name>instance-00000031</name>
Aug 09 01:25:17 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:25:17 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:25:17 user nova-compute[72780]:   <metadata>
Aug 09 01:25:17 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:25:17 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:25:17 user nova-compute[72780]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-437117913</nova:name>
Aug 09 01:25:17 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:25:17</nova:creationTime>
Aug 09 01:25:17 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:25:17 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:25:17 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:25:17 user nova-compute[72780]:       <nova:owner>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:user uuid="0c7abd6cb25b47b58ccd80d9fda7ece0">tempest-AttachVolumeShelveTestJSON-1412186531-project-member</nova:user>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:project uuid="9dd3451d1fb641ad8106f8b4bcb68fc1">tempest-AttachVolumeShelveTestJSON-1412186531</nova:project>
Aug 09 01:25:17 user nova-compute[72780]:       </nova:owner>
Aug 09 01:25:17 user nova-compute[72780]:       <nova:root type="image" uuid="9c8f99ef-415f-4a1a-abdb-8957b5e88a76"/>
Aug 09 01:25:17 user nova-compute[72780]:       <nova:ports>
Aug 09 01:25:17 user nova-compute[72780]:         <nova:port uuid="b218b39d-459e-4b92-87a2-cdf5233b5324">
Aug 09 01:25:17 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 01:25:17 user nova-compute[72780]:         </nova:port>
Aug 09 01:25:17 user nova-compute[72780]:       </nova:ports>
Aug 09 01:25:17 user nova-compute[72780]:     </nova:instance>
Aug 09 01:25:17 user nova-compute[72780]:   </metadata>
Aug 09 01:25:17 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:25:17 user nova-compute[72780]:     <system>
Aug 09 01:25:17 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:25:17 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:25:17 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:25:17 user nova-compute[72780]:       <entry name="serial">13b7263c-2f83-4bb6-8459-133e93acba6e</entry>
Aug 09 01:25:17 user nova-compute[72780]:       <entry name="uuid">13b7263c-2f83-4bb6-8459-133e93acba6e</entry>
Aug 09 01:25:17 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:25:17 user nova-compute[72780]:     </system>
Aug 09 01:25:17 user nova-compute[72780]:   </sysinfo>
Aug 09 01:25:17 user nova-compute[72780]:   <os>
Aug 09 01:25:17 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:25:17 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:25:17 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:25:17 user nova-compute[72780]:   </os>
Aug 09 01:25:17 user nova-compute[72780]:   <features>
Aug 09 01:25:17 user nova-compute[72780]:     <acpi/>
Aug 09 01:25:17 user nova-compute[72780]:     <apic/>
Aug 09 01:25:17 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:25:17 user nova-compute[72780]:   </features>
Aug 09 01:25:17 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:25:17 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:25:17 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:25:17 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:25:17 user nova-compute[72780]:   </clock>
Aug 09 01:25:17 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:25:17 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:25:17 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:25:17 user nova-compute[72780]:   </cpu>
Aug 09 01:25:17 user nova-compute[72780]:   <devices>
Aug 09 01:25:17 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:25:17 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:25:17 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk"/>
Aug 09 01:25:17 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:25:17 user nova-compute[72780]:     </disk>
Aug 09 01:25:17 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:25:17 user nova-compute[72780]:       <mac address="fa:16:3e:15:db:87"/>
Aug 09 01:25:17 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:25:17 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:25:17 user nova-compute[72780]:       <target dev="tapb218b39d-45"/>
Aug 09 01:25:17 user nova-compute[72780]:     </interface>
Aug 09 01:25:17 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:25:17 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/console.log" append="off"/>
Aug 09 01:25:17 user nova-compute[72780]:     </serial>
Aug 09 01:25:17 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:25:17 user nova-compute[72780]:     <video>
Aug 09 01:25:17 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:25:17 user nova-compute[72780]:     </video>
Aug 09 01:25:17 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:25:17 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:25:17 user nova-compute[72780]:     </rng>
Aug 09 01:25:17 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:25:17 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:25:17 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:25:17 user nova-compute[72780]:     </memballoon>
Aug 09 01:25:17 user nova-compute[72780]:   </devices>
Aug 09 01:25:17 user nova-compute[72780]: </domain>
Aug 09 01:25:17 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437117913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437117913',id=49,image_ref='9c8f99ef-415f-4a1a-abdb-8957b5e88a76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1605457411',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-qgeuxdhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member',shelved_at='2023-08-09T01:23:22.769942',shelved_host='user',shelved_image_id='9c8f99ef-415f-4a1a-abdb-8957b5e88a76'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=13b7263c-2f83-4bb6-8459-133e93acba6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG os_vif [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb218b39d-45, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb218b39d-45, col_values=(('external_ids', {'iface-id': 'b218b39d-459e-4b92-87a2-cdf5233b5324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:db:87', 'vm-uuid': '13b7263c-2f83-4bb6-8459-133e93acba6e'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:17 user nova-compute[72780]: INFO os_vif [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45')
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:25:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] No VIF found with MAC fa:16:3e:15:db:87, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-507539b9-72b5-4023-9c70-7d9d83c10aaf req-bdd66197-5c82-43c6-b9af-f8c6d98bca44 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-507539b9-72b5-4023-9c70-7d9d83c10aaf req-bdd66197-5c82-43c6-b9af-f8c6d98bca44 service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-507539b9-72b5-4023-9c70-7d9d83c10aaf req-bdd66197-5c82-43c6-b9af-f8c6d98bca44 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-507539b9-72b5-4023-9c70-7d9d83c10aaf req-bdd66197-5c82-43c6-b9af-f8c6d98bca44 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG nova.compute.manager [req-507539b9-72b5-4023-9c70-7d9d83c10aaf req-bdd66197-5c82-43c6-b9af-f8c6d98bca44 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:25:19 user nova-compute[72780]: WARNING nova.compute.manager [req-507539b9-72b5-4023-9c70-7d9d83c10aaf req-bdd66197-5c82-43c6-b9af-f8c6d98bca44 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:19 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:20 user nova-compute[72780]: INFO nova.compute.manager [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Terminating instance
Aug 09 01:25:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bba0d43-b5d4-401b-9d75-0938eecbbe41 req-8b928cda-fbd9-4560-9105-fc4f3b690260 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-unplugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bba0d43-b5d4-401b-9d75-0938eecbbe41 req-8b928cda-fbd9-4560-9105-fc4f3b690260 service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bba0d43-b5d4-401b-9d75-0938eecbbe41 req-8b928cda-fbd9-4560-9105-fc4f3b690260 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3bba0d43-b5d4-401b-9d75-0938eecbbe41 req-8b928cda-fbd9-4560-9105-fc4f3b690260 service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bba0d43-b5d4-401b-9d75-0938eecbbe41 req-8b928cda-fbd9-4560-9105-fc4f3b690260 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-unplugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bba0d43-b5d4-401b-9d75-0938eecbbe41 req-8b928cda-fbd9-4560-9105-fc4f3b690260 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-unplugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544321.2628415, 13b7263c-2f83-4bb6-8459-133e93acba6e => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] VM Resumed (Lifecycle Event)
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance spawned successfully.
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-6303082c-976c-42c0-b401-cd5acd923468 req-56f39d25-a3fa-4856-92d6-ad4f0029a46a service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6303082c-976c-42c0-b401-cd5acd923468 req-56f39d25-a3fa-4856-92d6-ad4f0029a46a service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6303082c-976c-42c0-b401-cd5acd923468 req-56f39d25-a3fa-4856-92d6-ad4f0029a46a service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6303082c-976c-42c0-b401-cd5acd923468 req-56f39d25-a3fa-4856-92d6-ad4f0029a46a service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [req-6303082c-976c-42c0-b401-cd5acd923468 req-56f39d25-a3fa-4856-92d6-ad4f0029a46a service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:25:21 user nova-compute[72780]: WARNING nova.compute.manager [req-6303082c-976c-42c0-b401-cd5acd923468 req-56f39d25-a3fa-4856-92d6-ad4f0029a46a service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544321.2643301, 13b7263c-2f83-4bb6-8459-133e93acba6e => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] VM Started (Lifecycle Event)
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Instance destroyed successfully.
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.objects.instance [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lazy-loading 'resources' on Instance uuid eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-103639508',display_name='tempest-TestMinimumBasicScenario-server-103639508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-103639508',id=47,image_ref='f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8X8c1BVZ+LSFCEagJCQJfsoSRMLTR9o6b4qqhZa0UaXRDpU2omD5aMLCDFWRyf7rVbcJpVqYFHIdGZCySxMTIVkbIf2eJj3aKYyqAQU9KMtIOrqK13tNRff/aJsqGb3Q==',key_name='tempest-TestMinimumBasicScenario-612467624',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:20:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a85055d2cc3d47fdb496d109879dcf2c',ramdisk_id='',reservation_id='r-zv4m227m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f32f9506-bff2-4ca1-ae9a-6eb3aac9ce22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546637949',owner_user_name='tempest-TestMinimumBasicScenario-546637949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:22:40Z,user_data=None,user_id='b17e92fe6f4141a19ae4fa94c24eec52',uuid=eb03a2d2-6bec-43a8-bae9-ff7ab47ab840,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converting VIF {"id": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "address": "fa:16:3e:42:36:6b", "network": {"id": "3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1794611034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a85055d2cc3d47fdb496d109879dcf2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e78b117-43", "ovs_interfaceid": "1e78b117-43ae-4196-a94f-4ff4ab95139e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG os_vif [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e78b117-43, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:25:21 user nova-compute[72780]: INFO os_vif [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:36:6b,bridge_name='br-int',has_traffic_filtering=True,id=1e78b117-43ae-4196-a94f-4ff4ab95139e,network=Network(3dd9b996-2fbd-49f1-a544-7a8bea1b0cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e78b117-43')
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Deleting instance files /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840_del
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Deletion of /opt/stack/data/nova/instances/eb03a2d2-6bec-43a8-bae9-ff7ab47ab840_del complete
Aug 09 01:25:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:21 user nova-compute[72780]: INFO nova.compute.manager [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:25:21 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-38aed5ff-98f1-493d-a3f2-921e049a958f tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.627s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:22 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:25:22 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Took 0.68 seconds to deallocate network for instance.
Aug 09 01:25:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:22 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:25:22 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:25:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:22 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Deleted allocations for instance eb03a2d2-6bec-43a8-bae9-ff7ab47ab840
Aug 09 01:25:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-13b9a4b7-44f0-4e4b-93b3-048320dde220 tempest-TestMinimumBasicScenario-546637949 tempest-TestMinimumBasicScenario-546637949-project-member] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-312a5cf9-f7e1-4da9-beb6-9294dc20b6a5 req-aa534763-1f78-4c25-863d-6236a98a3b8d service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:25:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-312a5cf9-f7e1-4da9-beb6-9294dc20b6a5 req-aa534763-1f78-4c25-863d-6236a98a3b8d service nova] Acquiring lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-312a5cf9-f7e1-4da9-beb6-9294dc20b6a5 req-aa534763-1f78-4c25-863d-6236a98a3b8d service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-312a5cf9-f7e1-4da9-beb6-9294dc20b6a5 req-aa534763-1f78-4c25-863d-6236a98a3b8d service nova] Lock "eb03a2d2-6bec-43a8-bae9-ff7ab47ab840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-312a5cf9-f7e1-4da9-beb6-9294dc20b6a5 req-aa534763-1f78-4c25-863d-6236a98a3b8d service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] No waiting events found dispatching network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:25:23 user nova-compute[72780]: WARNING nova.compute.manager [req-312a5cf9-f7e1-4da9-beb6-9294dc20b6a5 req-aa534763-1f78-4c25-863d-6236a98a3b8d service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received unexpected event network-vif-plugged-1e78b117-43ae-4196-a94f-4ff4ab95139e for instance with vm_state deleted and task_state None.
Aug 09 01:25:23 user nova-compute[72780]: DEBUG nova.compute.manager [req-92a29ee9-67d9-4984-a3c7-5808c9f7e563 req-e0d56f06-111b-410e-84bc-7a315f248b89 service nova] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Received event network-vif-deleted-1e78b117-43ae-4196-a94f-4ff4ab95139e {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:25:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:25:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:25:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:25:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:25:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544321.542719, eb03a2d2-6bec-43a8-bae9-ff7ab47ab840 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:25:36 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] VM Stopped (Lifecycle Event)
Aug 09 01:25:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-316fc4b8-12fc-43ad-91db-d29733baaf19 None None] [instance: eb03a2d2-6bec-43a8-bae9-ff7ab47ab840] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:25:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:25:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:25:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8176MB free_disk=24.909622192382812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 13b7263c-2f83-4bb6-8459-133e93acba6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:25:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:25:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-changed-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:26:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Refreshing instance network info cache due to event network-changed-a7ab7086-4000-43ad-92f0-0967bead9f80. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:26:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] Acquiring lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:26:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] Acquired lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:26:03 user nova-compute[72780]: DEBUG nova.network.neutron [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Refreshing network info cache for port a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:26:04 user nova-compute[72780]: DEBUG nova.network.neutron [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updated VIF entry in instance network info cache for port a7ab7086-4000-43ad-92f0-0967bead9f80. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:26:04 user nova-compute[72780]: DEBUG nova.network.neutron [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:26:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-97d1d3be-171c-4073-beae-6b8dff30fdf0 req-e7140a4c-262c-404c-84e5-bf04c735f6a0 service nova] Releasing lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:26:05 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:26:09 user nova-compute[72780]: INFO nova.compute.manager [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attaching volume d5f7a986-a576-4b22-9963-6d8e75542569 to /dev/vdb
Aug 09 01:26:09 user nova-compute[72780]: DEBUG os_brick.utils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec7018a-ed98-4a16-94d4-4934468a359a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1ee52-6ccf-42f2-8c9f-176f256901d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c7ee53-11aa-4658-a6fc-a414c5f886f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5950ff-c2a5-41c3-9be5-36da2999251e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:26:09 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:26:09 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ebd648-9ff0-4f15-8285-46cdefa72246]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG os_brick.utils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:26:09 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating existing volume attachment record: abd6016c-9aa0-4edf-af11-fc2e91c0bcc2 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:26:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsDbekiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:26:17 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:26:17 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:26:17 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7007ea56-c829-4647-a2d8-34b826636dc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:26:17 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2b277-7dcc-4629-a7c0-9d947c0a54d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569] added
Aug 09 01:26:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d2761-28b6-49d4-a966-d4b5b295ac81]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4249d7-d872-4955-bfa2-b71782c93349]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsDbekiV {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsDbekiV" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecd5cbc-79f1-4672-a60b-f67e4ea7b206]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GsDbekiV'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a261cf2c-d54e-497c-bc1d-878281e94da8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[19247439-1c68-4ea6-b482-7ca6afb95d95]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:26:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:26:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb57b8-5e76-4398-8e38-ce226d2eddf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260]
Aug 09 01:26:17 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260] successful.
Aug 09 01:26:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79f6a5e-2a4e-43df-8d08-6e2f50b0e39d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9822c6-47e0-4bdd-b115-2fe3ddabb230]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:26:17 user nova-compute[72780]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)
Aug 09 01:26:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:26:17 user nova-compute[72780]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)
Aug 09 01:26:17 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6564b-1cf1-445c-802e-931b5e93e22a]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:26:17 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsDbekiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:26:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:26:18 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23538356265643530', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:26:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538356265643530', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:26:18 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:26:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:26:18 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:26:18 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:26:18 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:26:18 user nova-compute[72780]:   <serial>d5f7a986-a576-4b22-9963-6d8e75542569</serial>
Aug 09 01:26:18 user nova-compute[72780]: </disk>
Aug 09 01:26:18 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:26:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:26:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:26:19 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No VIF found with MAC fa:16:3e:92:5b:f3, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:26:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ded996d8-7df7-42ef-bd27-502a48af97d9 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.027s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:26:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.compute.manager [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing instance network info cache due to event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updated VIF entry in instance network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.network.neutron [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-0afae5a8-f040-475c-b783-e76b9c5629a3 req-3d31d76c-0690-4c0f-ab16-7917e5cc8fa7 service nova] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:26:29 user nova-compute[72780]: INFO nova.compute.manager [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Detaching volume 4ab0f459-0077-4489-b424-00159538f6ce
Aug 09 01:26:29 user nova-compute[72780]: INFO nova.virt.block_device [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Attempting to driver detach volume 4ab0f459-0077-4489-b424-00159538f6ce from mountpoint /dev/vdb
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Attempting to detach device vdb from instance d4532a1e-2830-4e60-9134-c9a34eec0d23 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:26:29 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:26:29 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:26:29 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:26:29 user nova-compute[72780]:   <serial>4ab0f459-0077-4489-b424-00159538f6ce</serial>
Aug 09 01:26:29 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:26:29 user nova-compute[72780]: </disk>
Aug 09 01:26:29 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:26:29 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully detached device vdb from instance d4532a1e-2830-4e60-9134-c9a34eec0d23 from the persistent domain config.
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4532a1e-2830-4e60-9134-c9a34eec0d23 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:26:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:26:29 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:26:29 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:26:29 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:26:29 user nova-compute[72780]:   <serial>4ab0f459-0077-4489-b424-00159538f6ce</serial>
Aug 09 01:26:29 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:26:29 user nova-compute[72780]: </disk>
Aug 09 01:26:29 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544390.3354733, d4532a1e-2830-4e60-9134-c9a34eec0d23 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:26:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully detached device vdb from instance d4532a1e-2830-4e60-9134-c9a34eec0d23 from the live domain config.
Aug 09 01:26:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUpWYwLB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:26:30 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d665b4a-91a3-4d7a-882d-fd4eba0ada50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[582fd4fd-9ceb-4ff2-846c-f40f7efb8c97]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:26:30 user nova-compute[72780]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)
Aug 09 01:26:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce (non-flash)
Aug 09 01:26:30 user nova-compute[72780]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)
Aug 09 01:26:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa06ba0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4a24f-2da6-4eba-beb7-a41cb86b568a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[06955f8c-c720-4732-820d-b1048f275316]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e086082-08f9-4f1c-b9db-28106b61d5aa]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a70c38-ef43-41e8-9395-1f93450ec4f6]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8cb439-8c40-4001-b4ce-89e4c2f010fb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb35069-7cd1-489a-a2ea-8ad9acb81bb5]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260]
Aug 09 01:26:30 user nova-compute[72780]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce, portal: 172.16.0.220,3260] successful.
Aug 09 01:26:30 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab0f459-0077-4489-b424-00159538f6ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22227068-578d-483d-a0f5-0803bfec237d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] <== disconnect_volume: return (272ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:26:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'flavor' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG nova.compute.manager [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing instance network info cache due to event network-changed-937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] Acquiring lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] Acquired lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Refreshing network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3c852b63-46e3-4c8a-8c12-567cc006f1ce tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.598s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updated VIF entry in instance network info cache for port 937fd312-f2e3-4cde-94a1-5a259c56d803. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG nova.network.neutron [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [{"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:26:31 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-b264066c-edaa-4c97-95c4-543ad7c29da5 req-1815a9d2-19cc-45f3-9eeb-7322f60482e8 service nova] Releasing lock "refresh_cache-d4532a1e-2830-4e60-9134-c9a34eec0d23" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [{"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-f2b9c8e3-3ca7-452d-a586-11130fa4442a" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:26:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:26:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:26:42 user nova-compute[72780]: INFO nova.compute.manager [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Detaching volume d5f7a986-a576-4b22-9963-6d8e75542569
Aug 09 01:26:42 user nova-compute[72780]: INFO nova.virt.block_device [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attempting to driver detach volume d5f7a986-a576-4b22-9963-6d8e75542569 from mountpoint /dev/vdb
Aug 09 01:26:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Attempting to detach device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:26:42 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:26:42 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:26:42 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:26:42 user nova-compute[72780]:   <serial>d5f7a986-a576-4b22-9963-6d8e75542569</serial>
Aug 09 01:26:42 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:26:42 user nova-compute[72780]: </disk>
Aug 09 01:26:42 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:26:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config.
Aug 09 01:26:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:26:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:26:42 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:26:42 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:26:42 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:26:42 user nova-compute[72780]:   <serial>d5f7a986-a576-4b22-9963-6d8e75542569</serial>
Aug 09 01:26:42 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:26:42 user nova-compute[72780]: </disk>
Aug 09 01:26:42 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544403.3461444, 07e29db5-d679-4196-9e76-1388d7466565 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:26:43 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config.
Aug 09 01:26:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsDbekiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:26:43 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca68455-c621-4caf-994a-e66a0b066544]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc81c6c5-ac1b-411f-8b2c-0c716e0e0cf9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)
Aug 09 01:26:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 (non-flash)
Aug 09 01:26:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa0684c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d863cd-74f0-4ecc-943a-a320b7ce2860]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ca3ef-4199-4ebf-8143-524863366cf3]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f968406-ee8d-423a-af45-3d292caf0451]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5594e52-1554-4607-9ef5-eb5912219f41]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d5fb2-71bc-424f-9df8-5ad0c633f6e4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75353c1-4a6e-48e9-9388-14fc5f866901]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260]
Aug 09 01:26:43 user nova-compute[72780]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569, portal: 172.16.0.220,3260] successful.
Aug 09 01:26:43 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5f7a986-a576-4b22-9963-6d8e75542569 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1d07e-8688-46ea-b06a-e2fb9f7e6cc3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== disconnect_volume: return (257ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:26:43 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:26:44 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:26:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c6010362-e08f-4e7f-91b9-9b0e3ae67a54 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.519s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:26:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:26:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:26:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:26:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:26:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:49 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:26:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:26:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:26:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=24.947391510009766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 13b7263c-2f83-4bb6-8459-133e93acba6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:26:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:26:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:26:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:26:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:26:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:26:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:26:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:01 user nova-compute[72780]: INFO nova.compute.manager [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Terminating instance
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-9aff09fa-a14a-4f68-a894-6854b901b322 req-3172ba79-1a68-494b-9c72-dd7083fbb776 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-unplugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9aff09fa-a14a-4f68-a894-6854b901b322 req-3172ba79-1a68-494b-9c72-dd7083fbb776 service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9aff09fa-a14a-4f68-a894-6854b901b322 req-3172ba79-1a68-494b-9c72-dd7083fbb776 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-9aff09fa-a14a-4f68-a894-6854b901b322 req-3172ba79-1a68-494b-9c72-dd7083fbb776 service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-9aff09fa-a14a-4f68-a894-6854b901b322 req-3172ba79-1a68-494b-9c72-dd7083fbb776 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-unplugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-9aff09fa-a14a-4f68-a894-6854b901b322 req-3172ba79-1a68-494b-9c72-dd7083fbb776 service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-unplugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:27:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Instance destroyed successfully.
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lazy-loading 'resources' on Instance uuid 13b7263c-2f83-4bb6-8459-133e93acba6e {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-437117913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-437117913',id=49,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgviTv0o/AypdKIzucSq4Y2dL8AuAU/IhSawBkn0h6wtkTZ+gOPrH+m2nS8GLC7LRjrYX5giVN2QlVJwJkCINTEsJv8+uUE3Xd7jK/jFL8f+5cdX00HNuziGyFxPow5Ag==',key_name='tempest-keypair-1605457411',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:25:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd3451d1fb641ad8106f8b4bcb68fc1',ramdisk_id='',reservation_id='r-qgeuxdhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1412186531',owner_user_name='tempest-AttachVolumeShelveTestJSON-1412186531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7abd6cb25b47b58ccd80d9fda7ece0',uuid=13b7263c-2f83-4bb6-8459-133e93acba6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converting VIF {"id": "b218b39d-459e-4b92-87a2-cdf5233b5324", "address": "fa:16:3e:15:db:87", "network": {"id": "5347e317-bffe-4763-9992-e3e98071b2f3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-575073927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd3451d1fb641ad8106f8b4bcb68fc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb218b39d-45", "ovs_interfaceid": "b218b39d-459e-4b92-87a2-cdf5233b5324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG os_vif [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb218b39d-45, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:27:01 user nova-compute[72780]: INFO os_vif [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:87,bridge_name='br-int',has_traffic_filtering=True,id=b218b39d-459e-4b92-87a2-cdf5233b5324,network=Network(5347e317-bffe-4763-9992-e3e98071b2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb218b39d-45')
Aug 09 01:27:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Deleting instance files /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e_del
Aug 09 01:27:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Deletion of /opt/stack/data/nova/instances/13b7263c-2f83-4bb6-8459-133e93acba6e_del complete
Aug 09 01:27:02 user nova-compute[72780]: INFO nova.compute.manager [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 09 01:27:02 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:27:02 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:27:02 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:27:02 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:27:02 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Took 0.80 seconds to deallocate network for instance.
Aug 09 01:27:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:03 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Deleted allocations for instance 13b7263c-2f83-4bb6-8459-133e93acba6e
Aug 09 01:27:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-37b02591-da6a-4ef8-bc56-0377aab793dd tempest-AttachVolumeShelveTestJSON-1412186531 tempest-AttachVolumeShelveTestJSON-1412186531-project-member] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] Acquiring lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] Lock "13b7263c-2f83-4bb6-8459-133e93acba6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] No waiting events found dispatching network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:27:03 user nova-compute[72780]: WARNING nova.compute.manager [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received unexpected event network-vif-plugged-b218b39d-459e-4b92-87a2-cdf5233b5324 for instance with vm_state deleted and task_state None.
Aug 09 01:27:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-3772170a-6930-4432-bd98-986c4ccaca5c req-31955e31-dddc-4f8d-b7a9-70cef619956d service nova] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Received event network-vif-deleted-b218b39d-459e-4b92-87a2-cdf5233b5324 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Verify base images {{(pid=72780) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Image id f43f2d4e-45ef-42ce-9cde-789adcfd9b22 yields fingerprint 69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 {{(pid=72780) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] image f43f2d4e-45ef-42ce-9cde-789adcfd9b22 at (/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64): checking
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] image f43f2d4e-45ef-42ce-9cde-789adcfd9b22 at (/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64): image is in use {{(pid=72780) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72780) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] d4532a1e-2830-4e60-9134-c9a34eec0d23 is a valid instance name {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] d4532a1e-2830-4e60-9134-c9a34eec0d23 has a disk file {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance d4532a1e-2830-4e60-9134-c9a34eec0d23 is backed by 69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] f2b9c8e3-3ca7-452d-a586-11130fa4442a is a valid instance name {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] f2b9c8e3-3ca7-452d-a586-11130fa4442a has a disk file {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a is backed by 69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] be87d2a1-c64a-414f-87f9-17e54b7ce18f is a valid instance name {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] be87d2a1-c64a-414f-87f9-17e54b7ce18f has a disk file {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f is backed by 69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] 07e29db5-d679-4196-9e76-1388d7466565 is a valid instance name {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] 07e29db5-d679-4196-9e76-1388d7466565 has a disk file {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 is backed by 69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 {{(pid=72780) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47
Aug 09 01:27:06 user nova-compute[72780]: WARNING nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Unknown base file: /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Active base files: /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Removable base files: /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22 /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9 /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6 /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47 /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/536fbddef1f7485e69c60cde24e3a6891f199c3e
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6d07a47c4bc25b29c20f2131ce81643dd68a2f22
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/30153b777f0e9c5007cf7138bfc8e19da27b32bf
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/52a889315edd41453fab6eb7db6c04f99069cb2e
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2cf68b69a3b75adfe955543c85412977c8d028b9
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a891261a9fffd72c56813882dcd403c81972c1d6
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0644982efb75b1724910056905754e2d0ac2c99b
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/458507dfa1733b8e984df6f532536ed357b09e47
Aug 09 01:27:06 user nova-compute[72780]: INFO nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d07564c48cf40a91c7456d73fe209e601c5549c3
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Verification complete {{(pid=72780) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Verify swap images {{(pid=72780) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.imagecache [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Verify ephemeral images {{(pid=72780) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 01:27:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:16 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544421.9366512, 13b7263c-2f83-4bb6-8459-133e93acba6e => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:27:16 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] VM Stopped (Lifecycle Event)
Aug 09 01:27:16 user nova-compute[72780]: DEBUG nova.compute.manager [None req-fde95970-1b89-4f37-b1b1-6f4e915f65fb None None] [instance: 13b7263c-2f83-4bb6-8459-133e93acba6e] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:27:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:20 user nova-compute[72780]: INFO nova.compute.manager [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Terminating instance
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.compute.manager [req-a10e7b07-f6e0-4acb-8d8f-cf507e99de3b req-a0b98331-6bad-4ee0-9d9b-a3e641165335 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a10e7b07-f6e0-4acb-8d8f-cf507e99de3b req-a0b98331-6bad-4ee0-9d9b-a3e641165335 service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a10e7b07-f6e0-4acb-8d8f-cf507e99de3b req-a0b98331-6bad-4ee0-9d9b-a3e641165335 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a10e7b07-f6e0-4acb-8d8f-cf507e99de3b req-a0b98331-6bad-4ee0-9d9b-a3e641165335 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.compute.manager [req-a10e7b07-f6e0-4acb-8d8f-cf507e99de3b req-a0b98331-6bad-4ee0-9d9b-a3e641165335 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.compute.manager [req-a10e7b07-f6e0-4acb-8d8f-cf507e99de3b req-a0b98331-6bad-4ee0-9d9b-a3e641165335 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-unplugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Instance destroyed successfully.
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.objects.instance [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'resources' on Instance uuid d4532a1e-2830-4e60-9134-c9a34eec0d23 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516536775',display_name='tempest-ServerRescueNegativeTestJSON-server-1516536775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516536775',id=48,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKu0i3FnQRZtx4XRq4/FdFbFeX7zEePWtu9dZo+Kz046V5fxY3Naf1dzy8LQVIfdH7jVg9QIP1LQc3ozYndIRXEXi2QuUsVADIpF4FOvOVNpKpWTKKAsoeFs0NxUm/gFg==',key_name='tempest-keypair-2084992097',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ymoavt3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59257e56086046b0a27ce3880c309586',uuid=d4532a1e-2830-4e60-9134-c9a34eec0d23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "937fd312-f2e3-4cde-94a1-5a259c56d803", "address": "fa:16:3e:b2:e5:e8", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937fd312-f2", "ovs_interfaceid": "937fd312-f2e3-4cde-94a1-5a259c56d803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG os_vif [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap937fd312-f2, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:27:20 user nova-compute[72780]: INFO os_vif [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:e8,bridge_name='br-int',has_traffic_filtering=True,id=937fd312-f2e3-4cde-94a1-5a259c56d803,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937fd312-f2')
Aug 09 01:27:20 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Deleting instance files /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23_del
Aug 09 01:27:20 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Deletion of /opt/stack/data/nova/instances/d4532a1e-2830-4e60-9134-c9a34eec0d23_del complete
Aug 09 01:27:21 user nova-compute[72780]: INFO nova.compute.manager [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 01:27:21 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:27:21 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:27:21 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:27:22 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Took 1.02 seconds to deallocate network for instance.
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:22 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Deleted allocations for instance d4532a1e-2830-4e60-9134-c9a34eec0d23
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-a2c35860-9444-4074-8d20-1a28baadb387 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] Acquiring lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] Lock "d4532a1e-2830-4e60-9134-c9a34eec0d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] No waiting events found dispatching network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:27:22 user nova-compute[72780]: WARNING nova.compute.manager [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received unexpected event network-vif-plugged-937fd312-f2e3-4cde-94a1-5a259c56d803 for instance with vm_state deleted and task_state None.
Aug 09 01:27:22 user nova-compute[72780]: DEBUG nova.compute.manager [req-6ad507ec-90dc-47ed-8a5f-97de63d7ba31 req-f9dd9e2d-82b7-435f-8b26-512aedf8eea3 service nova] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Received event network-vif-deleted-937fd312-f2e3-4cde-94a1-5a259c56d803 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:27:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:27:33 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [{"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-be87d2a1-c64a-414f-87f9-17e54b7ce18f" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544440.9251072, d4532a1e-2830-4e60-9134-c9a34eec0d23 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:27:35 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] VM Stopped (Lifecycle Event)
Aug 09 01:27:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-430f941e-4b47-416d-a03d-cc10c1887bd7 None None] [instance: d4532a1e-2830-4e60-9134-c9a34eec0d23] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:27:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:37 user nova-compute[72780]: INFO nova.compute.manager [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attaching volume a82effb3-d828-476a-9519-a027ce651fe7 to /dev/vdb
Aug 09 01:27:37 user nova-compute[72780]: DEBUG os_brick.utils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6111a6-8ff0-4f74-a404-d4d5f35c7916]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c0a20-7ed0-4a46-ab5a-540cbd9a5dae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0815eeb7-9423-4d34-a2d1-94cc7aaa849a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a5ba52-a10d-4494-a20d-dc20f497c751]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:27:37 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:27:37 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9462f92f-ec24-48d0-8208-9e3f3125cfaa]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG os_brick.utils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:27:37 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating existing volume attachment record: 28bb9272-bd6f-4716-9181-cdebc290c3a5 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:27:40 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:27:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:27:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBGnjXSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:27:45 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:27:45 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:27:45 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba19d4-556f-41e8-9f03-dc9d952b8b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:27:45 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4311f4-ddb3-4ef3-9181-657f228f8be1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7] added
Aug 09 01:27:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ce1f9-83d8-4947-a25d-b6a1e66255eb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcfffef-30d8-4fb7-a450-19d26026d62c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBGnjXSK {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBGnjXSK" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83ea2c5-3909-4928-8ce1-27f89d005f33]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBGnjXSK'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba97b99-b22d-4530-b516-dd9c7efcc2d6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62381a2c-ffb9-4100-bbf0-05f5ef6ba365]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:27:45 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:27:45 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:27:45 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:27:45 user nova-compute[72780]: 
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b6587-39cd-49ae-a0a4-85f25ee64df2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260]
Aug 09 01:27:45 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260] successful.
Aug 09 01:27:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d5a94c-4990-4de9-b723-450e45f29da3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a5d463-464d-4d99-b7af-38d60c277da9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 (non-flash)
Aug 09 01:27:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 (non-flash)
Aug 09 01:27:45 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe04f62-55ac-4813-99be-b9c771a4ad30]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:27:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBGnjXSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23437633730633537', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633730633537', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:27:46 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:27:46 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:27:46 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:27:46 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:27:46 user nova-compute[72780]:   <serial>a82effb3-d828-476a-9519-a027ce651fe7</serial>
Aug 09 01:27:46 user nova-compute[72780]: </disk>
Aug 09 01:27:46 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:27:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:27:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:27:47 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No VIF found with MAC fa:16:3e:92:5b:f3, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:27:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e3cd296b-2c75-4b5d-bbdc-8abb1ce81d29 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.760s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:49 user nova-compute[72780]: INFO nova.compute.manager [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Detaching volume a82effb3-d828-476a-9519-a027ce651fe7
Aug 09 01:27:49 user nova-compute[72780]: INFO nova.virt.block_device [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attempting to driver detach volume a82effb3-d828-476a-9519-a027ce651fe7 from mountpoint /dev/vdb
Aug 09 01:27:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Attempting to detach device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:27:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:27:49 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:27:49 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:27:49 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:27:49 user nova-compute[72780]:   <serial>a82effb3-d828-476a-9519-a027ce651fe7</serial>
Aug 09 01:27:49 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:27:49 user nova-compute[72780]: </disk>
Aug 09 01:27:49 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:27:49 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config.
Aug 09 01:27:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:27:49 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:27:49 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:27:49 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:27:49 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:27:49 user nova-compute[72780]:   <serial>a82effb3-d828-476a-9519-a027ce651fe7</serial>
Aug 09 01:27:49 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:27:49 user nova-compute[72780]: </disk>
Aug 09 01:27:49 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544470.231024, 07e29db5-d679-4196-9e76-1388d7466565 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:27:50 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config.
Aug 09 01:27:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBGnjXSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:27:50 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8eae2-5d20-4ce7-bcac-e0aa2fc6acfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f36fc8-0d7f-474b-92f0-4c7199f271c1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 (non-flash)
Aug 09 01:27:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 (non-flash)
Aug 09 01:27:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fb9ed-4d4f-4e83-8cf1-556ec50810c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aed00e-be29-405b-9f3e-d9b3cca7bb4e]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c51197-5be5-49f8-bd94-b123ea3f4ef0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99afd01-7f7c-47a0-aa1b-0f3f3c8ee51b]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca38e28b-ac4e-4512-8da7-0bd807566721]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedfc8d9-de42-4fa4-8111-29d116cfb2ee]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260]
Aug 09 01:27:50 user nova-compute[72780]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7, portal: 172.16.0.220,3260] successful.
Aug 09 01:27:50 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a82effb3-d828-476a-9519-a027ce651fe7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1cf2c8-acf8-4463-a320-80599321a1fb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== disconnect_volume: return (310ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9dba35f1-c675-4378-b28b-f72fd244cbae tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.703s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:27:51 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:27:51 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.002166748046875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:27:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance be87d2a1-c64a-414f-87f9-17e54b7ce18f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:27:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:27:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:27:57 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:03 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:28:17 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:28:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:24 user nova-compute[72780]: INFO nova.compute.manager [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Terminating instance
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-c600097c-b723-47a3-9f3c-88e577856794 req-1a02ce60-3a66-40e6-b977-cb4c8d0a971a service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-unplugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c600097c-b723-47a3-9f3c-88e577856794 req-1a02ce60-3a66-40e6-b977-cb4c8d0a971a service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c600097c-b723-47a3-9f3c-88e577856794 req-1a02ce60-3a66-40e6-b977-cb4c8d0a971a service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c600097c-b723-47a3-9f3c-88e577856794 req-1a02ce60-3a66-40e6-b977-cb4c8d0a971a service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-c600097c-b723-47a3-9f3c-88e577856794 req-1a02ce60-3a66-40e6-b977-cb4c8d0a971a service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-unplugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.compute.manager [req-c600097c-b723-47a3-9f3c-88e577856794 req-1a02ce60-3a66-40e6-b977-cb4c8d0a971a service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-unplugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:28:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Instance destroyed successfully.
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'resources' on Instance uuid be87d2a1-c64a-414f-87f9-17e54b7ce18f {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-314315361',display_name='tempest-ServerRescueNegativeTestJSON-server-314315361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-314315361',id=40,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:14:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-ifpvm170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:14:05Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=be87d2a1-c64a-414f-87f9-17e54b7ce18f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "address": "fa:16:3e:ed:96:29", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap604d0086-a5", "ovs_interfaceid": "604d0086-a5dd-4ffb-ac97-6c2d398bfbff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG os_vif [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap604d0086-a5, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:28:24 user nova-compute[72780]: INFO os_vif [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:96:29,bridge_name='br-int',has_traffic_filtering=True,id=604d0086-a5dd-4ffb-ac97-6c2d398bfbff,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap604d0086-a5')
Aug 09 01:28:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Deleting instance files /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f_del
Aug 09 01:28:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Deletion of /opt/stack/data/nova/instances/be87d2a1-c64a-414f-87f9-17e54b7ce18f_del complete
Aug 09 01:28:24 user nova-compute[72780]: INFO nova.compute.manager [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 01:28:24 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:28:24 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:28:25 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:28:25 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Took 0.56 seconds to deallocate network for instance.
Aug 09 01:28:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:25 user nova-compute[72780]: DEBUG nova.compute.manager [req-903076af-db68-4891-8a7f-6df33476c2ab req-3d67c6f7-8f08-448a-aca9-b7e4fc492864 service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-deleted-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:28:25 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:28:25 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:28:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:25 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Deleted allocations for instance be87d2a1-c64a-414f-87f9-17e54b7ce18f
Aug 09 01:28:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-9fb2439a-20d5-4ed1-a938-4cba44991b24 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-c3410096-4a02-484f-8a68-b535b771aa56 req-9cd3c764-bd68-4280-a644-77caf3575dcc service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:28:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c3410096-4a02-484f-8a68-b535b771aa56 req-9cd3c764-bd68-4280-a644-77caf3575dcc service nova] Acquiring lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c3410096-4a02-484f-8a68-b535b771aa56 req-9cd3c764-bd68-4280-a644-77caf3575dcc service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c3410096-4a02-484f-8a68-b535b771aa56 req-9cd3c764-bd68-4280-a644-77caf3575dcc service nova] Lock "be87d2a1-c64a-414f-87f9-17e54b7ce18f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-c3410096-4a02-484f-8a68-b535b771aa56 req-9cd3c764-bd68-4280-a644-77caf3575dcc service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] No waiting events found dispatching network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:28:26 user nova-compute[72780]: WARNING nova.compute.manager [req-c3410096-4a02-484f-8a68-b535b771aa56 req-9cd3c764-bd68-4280-a644-77caf3575dcc service nova] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Received unexpected event network-vif-plugged-604d0086-a5dd-4ffb-ac97-6c2d398bfbff for instance with vm_state deleted and task_state None.
Aug 09 01:28:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:34 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:28:35 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:28:39 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544504.7882824, be87d2a1-c64a-414f-87f9-17e54b7ce18f => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:28:39 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] VM Stopped (Lifecycle Event)
Aug 09 01:28:39 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-2733149c-5cec-4678-84e7-3bb1718f5c1d None None] [instance: be87d2a1-c64a-414f-87f9-17e54b7ce18f] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:28:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:43 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:44 user nova-compute[72780]: INFO nova.compute.manager [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attaching volume a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 to /dev/vdb
Aug 09 01:28:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG os_brick.utils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5019c6-afdb-42e4-b381-59b7a42b9271]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b476a-3461-4a1b-8939-7aba31f68d33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dbacfd-19f1-4f17-a4ab-054abd7ab3ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd6026b-833d-455d-ac50-d3dc948b56bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:28:44 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:28:44 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da9f64e-1fd3-4e8d-a49d-c819cc6f6049]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG os_brick.utils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating existing volume attachment record: 86b7751f-2086-4848-b4a9-639606180ed3 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:28:44 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:28:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:49 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFpAtQTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:28:52 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:28:52 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:28:52 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424ccbe-dda6-4e68-ae4e-3e620bdd3170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:28:52 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedcc7a2-b589-47b4-8ec4-7583569211e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0] added
Aug 09 01:28:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[32832719-6b09-4ad7-8436-f4682502dd06]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dae41b-bd2c-45c9-9146-73c92dd2a96c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFpAtQTB {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFpAtQTB" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e071af73-18e5-4032-8004-4da45e44caa8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFpAtQTB'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de1e88-be9f-4793-bb05-7128ea630b5d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[26926ce7-8058-4b57-91d5-8dd9caae082e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:28:52 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:28:52 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:28:52 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:28:52 user nova-compute[72780]: 
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccdd208-72c0-4f22-8215-c8e69618dc79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260]
Aug 09 01:28:52 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260] successful.
Aug 09 01:28:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78ac516-fe15-44f4-ae4f-593acc6b27e6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da5648d-ed6b-43a9-8e42-42b8e6797687]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 (non-flash)
Aug 09 01:28:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 (non-flash)
Aug 09 01:28:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d178e695-4d14-4589-8b2c-de7cf763cba7]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFpAtQTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:28:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:53 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:28:53 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=25.018898010253906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance f2b9c8e3-3ca7-452d-a586-11130fa4442a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23239323133383335', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239323133383335', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:28:53 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:28:53 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:28:53 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:28:53 user nova-compute[72780]:   <serial>a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0</serial>
Aug 09 01:28:53 user nova-compute[72780]: </disk>
Aug 09 01:28:53 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:28:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No VIF found with MAC fa:16:3e:92:5b:f3, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b185ae5c-1e41-421f-89e5-3d533e1879c8 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.193s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.590s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:28:56 user nova-compute[72780]: INFO nova.compute.manager [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Detaching volume a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0
Aug 09 01:28:56 user nova-compute[72780]: INFO nova.virt.block_device [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attempting to driver detach volume a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 from mountpoint /dev/vdb
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Attempting to detach device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:28:56 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:28:56 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:28:56 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:28:56 user nova-compute[72780]:   <serial>a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0</serial>
Aug 09 01:28:56 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:28:56 user nova-compute[72780]: </disk>
Aug 09 01:28:56 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:28:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config.
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:28:56 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:28:56 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:28:56 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:28:56 user nova-compute[72780]:   <serial>a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0</serial>
Aug 09 01:28:56 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:28:56 user nova-compute[72780]: </disk>
Aug 09 01:28:56 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544536.9864542, 07e29db5-d679-4196-9e76-1388d7466565 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:28:56 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config.
Aug 09 01:28:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFpAtQTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:28:56 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:28:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:28:56 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac6266-607e-4ec5-869a-d8749d028ca5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[801231e3-1d51-43cf-b082-4090ef5e73cc]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 (non-flash)
Aug 09 01:28:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 (non-flash)
Aug 09 01:28:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01afbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8adf5f2-e815-4856-a554-ca8488f84394]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ea48fc-c552-4095-9c50-4b6419e19586]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861ee74-7d18-48b6-b138-bd47bcdfb397]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c71d7f3-2276-471f-b64e-00e55c99150f]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fbe674-e93e-4244-98a3-4a8b11025f16]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c91588-de2a-4c8b-b02a-7a4e0ab28d3f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260]
Aug 09 01:28:57 user nova-compute[72780]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0, portal: 172.16.0.220,3260] successful.
Aug 09 01:28:57 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ab7f09-b2bf-4248-9bf0-d4d03ba4d5d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5261f43-d43d-4f5f-89fa-939f0699500a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== disconnect_volume: return (253ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:28:57 user nova-compute[72780]: DEBUG nova.objects.instance [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:28:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-af0d6a25-ce6d-497d-9d16-81b890ce4fa7 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.585s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:28:59 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:04 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:29:04 user nova-compute[72780]: INFO nova.compute.claims [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Claim successful on node user
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:29:05 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:29:05 user nova-compute[72780]: INFO nova.virt.block_device [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Booting with volume 91b274e7-02a8-4b82-b518-cc5e290c4638 at /dev/vda
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.policy [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e415eef2a89e4144a8ee0e10528276e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c8087caca54d899ce8bd2251c8ea8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG os_brick.utils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6254f82-87f2-4e2e-95e0-5a3739cd5387]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6798887-56d9-4dca-989b-9162b2e659b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[17788d16-ad02-43ff-b76a-a3de60cc127c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f017b456-d845-4651-ad33-4f5a3751f6d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:29:05 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:29:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[73092d29-3a11-444f-892b-022f63cf0b22]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG os_brick.utils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:29:05 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating existing volume attachment record: b8029f24-d4f2-4201-b3e7-140a33a57d60 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:29:06 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Successfully created port: 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:29:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Successfully updated port: 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.compute.manager [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing instance network info cache due to event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance network_info: |[{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated VIF entry in instance network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG nova.network.neutron [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:29:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a274cd69-c62c-4718-b9e2-8eb1f9109a4e req-aa0fcf6c-8df6-4bef-be6d-29ea4e0a3f15 service nova] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:29:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:29:13 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Creating image(s)
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Ensure instance console log exists: /opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Start _get_guest_xml network_info=[{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1eb1b69-7908-4090-aad0-208e8cf22d71', 'attached_at': '', 'detached_at': '', 'volume_id': '91b274e7-02a8-4b82-b518-cc5e290c4638', 'serial': '91b274e7-02a8-4b82-b518-cc5e290c4638'}, 'disk_bus': 'virtio', 'attachment_id': 'b8029f24-d4f2-4201-b3e7-140a33a57d60', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:29:13 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:29:13 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:29:13 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:29:13 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:29:13 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8597b6-f0a5-4bdd-80bc-79453d983bba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:29:13 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6afbe04-3323-4cf7-b8ce-2add92db4ea1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638] added
Aug 09 01:29:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[64278484-f162-44b4-992e-b16774add054]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8512d-05e1-4e2d-98b1-6996d7e17d60]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiCaxpDO {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiCaxpDO" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187fd3a-d221-42f2-90aa-1c6e8bd12536]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiCaxpDO'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc42660-80a0-4292-b45b-296b41f9066f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8befb68b-aecc-4f5e-9162-e59eed2907c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:29:13 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:29:13 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:29:13 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:29:13 user nova-compute[72780]: 
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e647de0-4ce9-4311-a759-ca2fc3c20d7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]
Aug 09 01:29:13 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.
Aug 09 01:29:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d3a824-3f8e-4c22-99ba-a7567f7f9524]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a809b-10fe-4674-adb2-8cd160b0742a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:29:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:29:13 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca61d587-b738-4d04-9cda-22223d3444b3]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:13 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:14 user nova-compute[72780]: INFO nova.compute.manager [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Terminating instance
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23638396636663832', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638396636663832', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1047706793',display_name='tempest-TestShelveInstance-server-1047706793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1047706793',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOXLOQzi/crzTxTn7fJ2ut+0fDmEVG7P3PqYSBWokObu3U0YPG1fyil8HFggMPO0+gYNF9Hk7cGqmbiRW1ATvPxt+FxXVBz0vRT/7Pg2iZBBkN5A8a5DaE/trb6yHootA==',key_name='tempest-TestShelveInstance-582543827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3c8087caca54d899ce8bd2251c8ea8b',ramdisk_id='',reservation_id='r-z03y1qpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1571414278',owner_user_name='tempest-TestShelveInstance-1571414278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:29:05Z,user_data=None,user_id='e415eef2a89e4144a8ee0e10528276e1',uuid=c1eb1b69-7908-4090-aad0-208e8cf22d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converting VIF {"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'pci_devices' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:29:14 user nova-compute[72780]:   <uuid>c1eb1b69-7908-4090-aad0-208e8cf22d71</uuid>
Aug 09 01:29:14 user nova-compute[72780]:   <name>instance-00000033</name>
Aug 09 01:29:14 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:29:14 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:29:14 user nova-compute[72780]:   <metadata>
Aug 09 01:29:14 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:29:14 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:29:14 user nova-compute[72780]:       <nova:name>tempest-TestShelveInstance-server-1047706793</nova:name>
Aug 09 01:29:14 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:29:13</nova:creationTime>
Aug 09 01:29:14 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:29:14 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:29:14 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:29:14 user nova-compute[72780]:       <nova:owner>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:user uuid="e415eef2a89e4144a8ee0e10528276e1">tempest-TestShelveInstance-1571414278-project-member</nova:user>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:project uuid="f3c8087caca54d899ce8bd2251c8ea8b">tempest-TestShelveInstance-1571414278</nova:project>
Aug 09 01:29:14 user nova-compute[72780]:       </nova:owner>
Aug 09 01:29:14 user nova-compute[72780]:       <nova:ports>
Aug 09 01:29:14 user nova-compute[72780]:         <nova:port uuid="195cdff9-8c70-47cb-9f50-4b2e306698b1">
Aug 09 01:29:14 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 01:29:14 user nova-compute[72780]:         </nova:port>
Aug 09 01:29:14 user nova-compute[72780]:       </nova:ports>
Aug 09 01:29:14 user nova-compute[72780]:     </nova:instance>
Aug 09 01:29:14 user nova-compute[72780]:   </metadata>
Aug 09 01:29:14 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:29:14 user nova-compute[72780]:     <system>
Aug 09 01:29:14 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:29:14 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:29:14 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:29:14 user nova-compute[72780]:       <entry name="serial">c1eb1b69-7908-4090-aad0-208e8cf22d71</entry>
Aug 09 01:29:14 user nova-compute[72780]:       <entry name="uuid">c1eb1b69-7908-4090-aad0-208e8cf22d71</entry>
Aug 09 01:29:14 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:29:14 user nova-compute[72780]:     </system>
Aug 09 01:29:14 user nova-compute[72780]:   </sysinfo>
Aug 09 01:29:14 user nova-compute[72780]:   <os>
Aug 09 01:29:14 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:29:14 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:29:14 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:29:14 user nova-compute[72780]:   </os>
Aug 09 01:29:14 user nova-compute[72780]:   <features>
Aug 09 01:29:14 user nova-compute[72780]:     <acpi/>
Aug 09 01:29:14 user nova-compute[72780]:     <apic/>
Aug 09 01:29:14 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:29:14 user nova-compute[72780]:   </features>
Aug 09 01:29:14 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:29:14 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:29:14 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:29:14 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:29:14 user nova-compute[72780]:   </clock>
Aug 09 01:29:14 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:29:14 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:29:14 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:29:14 user nova-compute[72780]:   </cpu>
Aug 09 01:29:14 user nova-compute[72780]:   <devices>
Aug 09 01:29:14 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:29:14 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:29:14 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 01:29:14 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:29:14 user nova-compute[72780]:       <serial>91b274e7-02a8-4b82-b518-cc5e290c4638</serial>
Aug 09 01:29:14 user nova-compute[72780]:     </disk>
Aug 09 01:29:14 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:29:14 user nova-compute[72780]:       <mac address="fa:16:3e:3b:f5:cd"/>
Aug 09 01:29:14 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:29:14 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:29:14 user nova-compute[72780]:       <target dev="tap195cdff9-8c"/>
Aug 09 01:29:14 user nova-compute[72780]:     </interface>
Aug 09 01:29:14 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:29:14 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71/console.log" append="off"/>
Aug 09 01:29:14 user nova-compute[72780]:     </serial>
Aug 09 01:29:14 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:29:14 user nova-compute[72780]:     <video>
Aug 09 01:29:14 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:29:14 user nova-compute[72780]:     </video>
Aug 09 01:29:14 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:29:14 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:29:14 user nova-compute[72780]:     </rng>
Aug 09 01:29:14 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:29:14 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:29:14 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:29:14 user nova-compute[72780]:     </memballoon>
Aug 09 01:29:14 user nova-compute[72780]:   </devices>
Aug 09 01:29:14 user nova-compute[72780]: </domain>
Aug 09 01:29:14 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1047706793',display_name='tempest-TestShelveInstance-server-1047706793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1047706793',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOXLOQzi/crzTxTn7fJ2ut+0fDmEVG7P3PqYSBWokObu3U0YPG1fyil8HFggMPO0+gYNF9Hk7cGqmbiRW1ATvPxt+FxXVBz0vRT/7Pg2iZBBkN5A8a5DaE/trb6yHootA==',key_name='tempest-TestShelveInstance-582543827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3c8087caca54d899ce8bd2251c8ea8b',ramdisk_id='',reservation_id='r-z03y1qpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1571414278',owner_user_name='tempest-TestShelveInstance-1571414278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:29:05Z,user_data=None,user_id='e415eef2a89e4144a8ee0e10528276e1',uuid=c1eb1b69-7908-4090-aad0-208e8cf22d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converting VIF {"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG os_vif [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195cdff9-8c, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap195cdff9-8c, col_values=(('external_ids', {'iface-id': '195cdff9-8c70-47cb-9f50-4b2e306698b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f5:cd', 'vm-uuid': 'c1eb1b69-7908-4090-aad0-208e8cf22d71'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:14 user nova-compute[72780]: INFO os_vif [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c')
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fb1d627-c868-48c1-ad0c-a8242d365a8f req-b1744344-5f99-48e4-83e0-b048b74c250a service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fb1d627-c868-48c1-ad0c-a8242d365a8f req-b1744344-5f99-48e4-83e0-b048b74c250a service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fb1d627-c868-48c1-ad0c-a8242d365a8f req-b1744344-5f99-48e4-83e0-b048b74c250a service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4fb1d627-c868-48c1-ad0c-a8242d365a8f req-b1744344-5f99-48e4-83e0-b048b74c250a service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fb1d627-c868-48c1-ad0c-a8242d365a8f req-b1744344-5f99-48e4-83e0-b048b74c250a service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-4fb1d627-c868-48c1-ad0c-a8242d365a8f req-b1744344-5f99-48e4-83e0-b048b74c250a service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-unplugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:29:14 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] No VIF found with MAC fa:16:3e:3b:f5:cd, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:29:15 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Instance destroyed successfully.
Aug 09 01:29:15 user nova-compute[72780]: DEBUG nova.objects.instance [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lazy-loading 'resources' on Instance uuid f2b9c8e3-3ca7-452d-a586-11130fa4442a {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1181529430',display_name='tempest-ServerRescueNegativeTestJSON-server-1181529430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1181529430',id=39,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9784ac1238a41e598ec36907111c770',ramdisk_id='',reservation_id='r-2xb7aij0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1588572554',owner_user_name='tempest-ServerRescueNegativeTestJSON-1588572554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:18:50Z,user_data=None,user_id='59257e56086046b0a27ce3880c309586',uuid=f2b9c8e3-3ca7-452d-a586-11130fa4442a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converting VIF {"id": "875e2936-190d-4d22-83bb-45e92e3737ea", "address": "fa:16:3e:8c:50:36", "network": {"id": "8c5da698-58d3-449f-b0b8-0b0c7a4f6963", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1689567372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9784ac1238a41e598ec36907111c770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875e2936-19", "ovs_interfaceid": "875e2936-190d-4d22-83bb-45e92e3737ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG os_vif [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875e2936-19, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:15 user nova-compute[72780]: INFO os_vif [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:50:36,bridge_name='br-int',has_traffic_filtering=True,id=875e2936-190d-4d22-83bb-45e92e3737ea,network=Network(8c5da698-58d3-449f-b0b8-0b0c7a4f6963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875e2936-19')
Aug 09 01:29:15 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Deleting instance files /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a_del
Aug 09 01:29:15 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Deletion of /opt/stack/data/nova/instances/f2b9c8e3-3ca7-452d-a586-11130fa4442a_del complete
Aug 09 01:29:15 user nova-compute[72780]: INFO nova.compute.manager [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 09 01:29:15 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:29:15 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:29:16 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Took 0.48 seconds to deallocate network for instance.
Aug 09 01:29:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-2d20dceb-06c0-456f-9cb1-19870fd5fcc9 req-fbe23ac7-ca17-43f7-b103-22fc7eae4b09 service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-deleted-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:16 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Deleted allocations for instance f2b9c8e3-3ca7-452d-a586-11130fa4442a
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-ee19a8f8-1fd9-4744-8adb-a63c54ecb028 tempest-ServerRescueNegativeTestJSON-1588572554 tempest-ServerRescueNegativeTestJSON-1588572554-project-member] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-fb526e0b-08f5-4a1c-bce0-98c06918ee76 req-ba34dccf-b554-43ea-b03e-64c686429e4c service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb526e0b-08f5-4a1c-bce0-98c06918ee76 req-ba34dccf-b554-43ea-b03e-64c686429e4c service nova] Acquiring lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb526e0b-08f5-4a1c-bce0-98c06918ee76 req-ba34dccf-b554-43ea-b03e-64c686429e4c service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fb526e0b-08f5-4a1c-bce0-98c06918ee76 req-ba34dccf-b554-43ea-b03e-64c686429e4c service nova] Lock "f2b9c8e3-3ca7-452d-a586-11130fa4442a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG nova.compute.manager [req-fb526e0b-08f5-4a1c-bce0-98c06918ee76 req-ba34dccf-b554-43ea-b03e-64c686429e4c service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] No waiting events found dispatching network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:29:16 user nova-compute[72780]: WARNING nova.compute.manager [req-fb526e0b-08f5-4a1c-bce0-98c06918ee76 req-ba34dccf-b554-43ea-b03e-64c686429e4c service nova] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Received unexpected event network-vif-plugged-875e2936-190d-4d22-83bb-45e92e3737ea for instance with vm_state deleted and task_state None.
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:29:18 user nova-compute[72780]: WARNING nova.compute.manager [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state building and task_state spawning.
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:29:18 user nova-compute[72780]: WARNING nova.compute.manager [req-27deab92-95c9-464d-995d-ae63f8ac208d req-ee874ffd-f268-4c0c-b92f-ccee386ad0d3 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state building and task_state spawning.
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544558.4585965, c1eb1b69-7908-4090-aad0-208e8cf22d71 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] VM Resumed (Lifecycle Event)
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance spawned successfully.
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544558.461246, c1eb1b69-7908-4090-aad0-208e8cf22d71 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] VM Started (Lifecycle Event)
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 09 01:29:18 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:29:18 user nova-compute[72780]: INFO nova.compute.manager [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Took 13.82 seconds to build instance.
Aug 09 01:29:18 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c590b9c2-be3f-4f93-9dc9-8387d8f1d0dd tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.910s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544555.7173479, f2b9c8e3-3ca7-452d-a586-11130fa4442a => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:29:30 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] VM Stopped (Lifecycle Event)
Aug 09 01:29:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-53306602-c93c-41f0-917f-eb3592f3d7dd None None] [instance: f2b9c8e3-3ca7-452d-a586-11130fa4442a] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:29:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:29:36 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:29:37 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:29:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:29:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:29:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:29:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:50 user nova-compute[72780]: INFO nova.compute.manager [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attaching volume bfc60e97-afbf-43b0-962b-b41c6b73cafe to /dev/vdb
Aug 09 01:29:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG os_brick.utils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac4bdd-4bec-4565-83cf-b1b57cc6518e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e41261e-862f-43ab-97ff-fd83c2dd25d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1959b8f-d4e0-42e5-9681-e175bda6adc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca31e17f-03f9-433f-964e-f747d2158582]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:29:50 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:29:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a4eb6a-d0b2-4316-9f35-fa5e59915499]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG os_brick.utils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:29:50 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating existing volume attachment record: 1fe22ec2-1a50-488d-9369-f62b7423bd4b {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:29:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:52 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:29:52 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:29:52 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=25.04450225830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:29:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c1eb1b69-7908-4090-aad0-208e8cf22d71 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:29:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:29:54 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:29:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDMrept', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:29:58 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:29:58 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:29:58 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a723ce4-2a55-449f-865c-1d319122c830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:29:58 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40da16-8dfe-42dc-88b6-3969501863a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe] added
Aug 09 01:29:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85d587f-799b-402e-893c-4f94b3383198]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d82dec-91f1-4551-8b66-bd04f9d46ef5]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwDMrept {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwDMrept" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a9c6be-eae3-4e61-84b9-f08fab038a7b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qwDMrept'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc1bd9c-b5a7-4768-ad49-983dc5607a71]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca28b54b-9e0c-4ed1-ac2e-567402d187c8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:29:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:29:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422d57c-2d23-4493-a950-18ce80e64fb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260]
Aug 09 01:29:58 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260] successful.
Aug 09 01:29:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[62beb1a8-c6ff-4651-8f82-462aee92f9b2]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7f471d-e247-4963-8a3c-961668da25dd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:29:58 user nova-compute[72780]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe (non-flash)
Aug 09 01:29:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:29:58 user nova-compute[72780]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe (non-flash)
Aug 09 01:29:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f8c0fc-ec61-4141-bcdb-7a746f789ee0]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:29:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDMrept', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:29:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:29:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26566363363383761', 'path': '/dev/sdc'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:29:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566363363383761', 'path': '/dev/sdc'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:29:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:29:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:29:59 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:29:59 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:29:59 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:29:59 user nova-compute[72780]:   <serial>bfc60e97-afbf-43b0-962b-b41c6b73cafe</serial>
Aug 09 01:29:59 user nova-compute[72780]: </disk>
Aug 09 01:29:59 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:30:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:30:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:30:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] No VIF found with MAC fa:16:3e:92:5b:f3, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:30:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c2109d5f-2591-4783-bb68-c3de60ca585c tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.716s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:30:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:30:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:30:02 user nova-compute[72780]: INFO nova.compute.manager [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Detaching volume bfc60e97-afbf-43b0-962b-b41c6b73cafe
Aug 09 01:30:03 user nova-compute[72780]: INFO nova.virt.block_device [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Attempting to driver detach volume bfc60e97-afbf-43b0-962b-b41c6b73cafe from mountpoint /dev/vdb
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Attempting to detach device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:30:03 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:30:03 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:30:03 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:30:03 user nova-compute[72780]:   <serial>bfc60e97-afbf-43b0-962b-b41c6b73cafe</serial>
Aug 09 01:30:03 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:30:03 user nova-compute[72780]: </disk>
Aug 09 01:30:03 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:30:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the persistent domain config.
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:30:03 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:30:03 user nova-compute[72780]:   <source dev="/dev/sdc"/>
Aug 09 01:30:03 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:30:03 user nova-compute[72780]:   <serial>bfc60e97-afbf-43b0-962b-b41c6b73cafe</serial>
Aug 09 01:30:03 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:30:03 user nova-compute[72780]: </disk>
Aug 09 01:30:03 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691544603.4877293, 07e29db5-d679-4196-9e76-1388d7466565 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:30:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully detached device vdb from instance 07e29db5-d679-4196-9e76-1388d7466565 from the live domain config.
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwDMrept', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:30:03 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec63c62-0023-4d41-bf35-81fe672e5520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a0eb1-9e0c-48b0-8d14-5f7992ab0b8b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:30:03 user nova-compute[72780]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe (non-flash)
Aug 09 01:30:03 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:30:03 user nova-compute[72780]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe (non-flash)
Aug 09 01:30:03 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0aa063d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe'): ({'sdc'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Removing single pathed devices sdc {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f6e1b3-0948-4b82-9660-885e94a5059c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b188d-6350-4aee-b329-76889b444615]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Flushing IO for device /dev/sdc {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4592c2d6-5484-48be-b7ee-6e221719adca]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[42525aa8-cdf5-44e2-bd41-e9753f37802d]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] SCSI volumes sdc have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[962c8044-686c-4f54-b215-62df0f5ecc50]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c805d35c-937b-4c96-92f4-4e60d4133f0d]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260]
Aug 09 01:30:03 user nova-compute[72780]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe, portal: 172.16.0.220,3260] successful.
Aug 09 01:30:03 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc60e97-afbf-43b0-962b-b41c6b73cafe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5290cae8-f1b8-416c-8c02-929750912a02]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] <== disconnect_volume: return (260ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:30:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:30:04 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:04 user nova-compute[72780]: DEBUG nova.objects.instance [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'flavor' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:30:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-5940570d-9e33-4012-92f4-f280f1c480fb tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:30:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:30:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:30:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:30:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:35 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:30:36 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:30:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:30:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:48 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:30:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:30:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:30:53 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:30:53 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.034225463867188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 07e29db5-d679-4196-9e76-1388d7466565 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c1eb1b69-7908-4090-aad0-208e8cf22d71 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:30:53 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:30:54 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:30:54 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:30:54 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:30:54 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:30:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:30:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:30:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:30:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG nova.compute.manager [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing instance network info cache due to event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated VIF entry in instance network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG nova.network.neutron [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:30:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-44699218-a672-43a4-9d71-3601bd4a7276 req-c4cc26e3-00f8-40e9-bb57-61c367012562 service nova] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:30:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:30:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:30:58 user nova-compute[72780]: INFO nova.compute.manager [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Shelve offloading
Aug 09 01:30:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-bc86d86b-4a38-4cc1-b598-830b3f79359e req-e2fef85c-114f-4b42-951a-2d9ebcaf8b93 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-unplugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bc86d86b-4a38-4cc1-b598-830b3f79359e req-e2fef85c-114f-4b42-951a-2d9ebcaf8b93 service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bc86d86b-4a38-4cc1-b598-830b3f79359e req-e2fef85c-114f-4b42-951a-2d9ebcaf8b93 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-bc86d86b-4a38-4cc1-b598-830b3f79359e req-e2fef85c-114f-4b42-951a-2d9ebcaf8b93 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-bc86d86b-4a38-4cc1-b598-830b3f79359e req-e2fef85c-114f-4b42-951a-2d9ebcaf8b93 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-unplugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:30:59 user nova-compute[72780]: WARNING nova.compute.manager [req-bc86d86b-4a38-4cc1-b598-830b3f79359e req-e2fef85c-114f-4b42-951a-2d9ebcaf8b93 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-unplugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state active and task_state shelving.
Aug 09 01:30:59 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance destroyed successfully.
Aug 09 01:30:59 user nova-compute[72780]: DEBUG nova.compute.manager [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:30:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance destroyed successfully.
Aug 09 01:31:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'resources' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1047706793',display_name='tempest-TestShelveInstance-server-1047706793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1047706793',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOXLOQzi/crzTxTn7fJ2ut+0fDmEVG7P3PqYSBWokObu3U0YPG1fyil8HFggMPO0+gYNF9Hk7cGqmbiRW1ATvPxt+FxXVBz0vRT/7Pg2iZBBkN5A8a5DaE/trb6yHootA==',key_name='tempest-TestShelveInstance-582543827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c8087caca54d899ce8bd2251c8ea8b',ramdisk_id='',reservation_id='r-z03y1qpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1571414278',owner_user_name='tempest-TestShelveInstance-1571414278-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:29:19Z,user_data=None,user_id='e415eef2a89e4144a8ee0e10528276e1',uuid=c1eb1b69-7908-4090-aad0-208e8cf22d71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converting VIF {"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG os_vif [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195cdff9-8c, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:00 user nova-compute[72780]: INFO os_vif [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c')
Aug 09 01:31:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:31:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:31:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:31:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a5efc-0280-40bd-9373-a2f38773bf10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[52126f87-51d5-4c97-a1d7-ff87896914b0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:31:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:31:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0178700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901e266-8579-4822-8623-2b04fc006f8d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e90ff-0d9a-4dc4-911d-4be51417badc]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:31:01 user nova-compute[72780]: WARNING nova.compute.manager [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state active and task_state shelving.
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.compute.manager [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing instance network info cache due to event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f330e9e-b400-447c-8bd1-d4d8df29efd7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ab546b-66fb-48a4-97da-fa900bdedbac]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e690e777-e304-4af8-894b-7ec3729b8d7b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8838f5d5-1087-4529-90df-0df8564bce7e]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]
Aug 09 01:31:01 user nova-compute[72780]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.
Aug 09 01:31:01 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f9ebe3-f99a-480d-94c1-e8d79e5cd801]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] <== disconnect_volume: return (286ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:31:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Deleting instance files /opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71_del
Aug 09 01:31:01 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Deletion of /opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71_del complete
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated VIF entry in instance network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG nova.network.neutron [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": null, "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap195cdff9-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-18feadab-eebc-472d-b99f-f64a42c30095 req-a57ae941-f520-4304-bd40-0bcd6745d92e service nova] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:31:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:02 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Deleted allocations for instance c1eb1b69-7908-4090-aad0-208e8cf22d71
Aug 09 01:31:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:02 user nova-compute[72780]: DEBUG nova.objects.instance [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'numa_topology' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:31:02 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:31:02 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:31:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-0fc9289e-4865-42b3-bd77-a292ffc60442 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.834s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:09 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:14 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544659.6395125, c1eb1b69-7908-4090-aad0-208e8cf22d71 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:31:14 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] VM Stopped (Lifecycle Event)
Aug 09 01:31:14 user nova-compute[72780]: DEBUG nova.compute.manager [None req-a490c66d-a9f9-400f-8b5e-3481ca07d547 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:31:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:31:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:31:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:31:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:37 user nova-compute[72780]: INFO nova.compute.manager [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Terminating instance
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd075904-321f-4e90-9f60-e46d5dc00011 req-ed7f0e87-2ef1-4e06-97cc-560fcdd70cb4 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-vif-unplugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd075904-321f-4e90-9f60-e46d5dc00011 req-ed7f0e87-2ef1-4e06-97cc-560fcdd70cb4 service nova] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd075904-321f-4e90-9f60-e46d5dc00011 req-ed7f0e87-2ef1-4e06-97cc-560fcdd70cb4 service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-fd075904-321f-4e90-9f60-e46d5dc00011 req-ed7f0e87-2ef1-4e06-97cc-560fcdd70cb4 service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd075904-321f-4e90-9f60-e46d5dc00011 req-ed7f0e87-2ef1-4e06-97cc-560fcdd70cb4 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] No waiting events found dispatching network-vif-unplugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:31:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-fd075904-321f-4e90-9f60-e46d5dc00011 req-ed7f0e87-2ef1-4e06-97cc-560fcdd70cb4 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-vif-unplugged-a7ab7086-4000-43ad-92f0-0967bead9f80 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [{"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-07e29db5-d679-4196-9e76-1388d7466565" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Instance destroyed successfully.
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.objects.instance [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lazy-loading 'resources' on Instance uuid 07e29db5-d679-4196-9e76-1388d7466565 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1294358660',display_name='tempest-SnapshotDataIntegrityTests-server-1294358660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1294358660',id=50,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrr/Kk9PkFRg/sPNeNkmbKXojl5FUDR6yT9RwDVRE0EmtAJmonKHyeQ1HK/+lLxJtaOY0NqvBM0dNQnEMgc5KJczgTNxmd906aVOTe2OT+bAif5X6QisImGUAEMNgjLhw==',key_name='tempest-keypair-732572729',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9b6f0d8351a429db3e9d429cac313bb',ramdisk_id='',reservation_id='r-0qn247jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1082386859',owner_user_name='tempest-SnapshotDataIntegrityTests-1082386859-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a4415483828447e847c9da37a629887',uuid=07e29db5-d679-4196-9e76-1388d7466565,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Converting VIF {"id": "a7ab7086-4000-43ad-92f0-0967bead9f80", "address": "fa:16:3e:92:5b:f3", "network": {"id": "0ca44969-93e5-4c61-9046-3d9eadcd93f1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1731632234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b6f0d8351a429db3e9d429cac313bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7086-40", "ovs_interfaceid": "a7ab7086-4000-43ad-92f0-0967bead9f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG os_vif [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7ab7086-40, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:38 user nova-compute[72780]: INFO os_vif [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:5b:f3,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7086-4000-43ad-92f0-0967bead9f80,network=Network(0ca44969-93e5-4c61-9046-3d9eadcd93f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7086-40')
Aug 09 01:31:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Deleting instance files /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565_del
Aug 09 01:31:38 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Deletion of /opt/stack/data/nova/instances/07e29db5-d679-4196-9e76-1388d7466565_del complete
Aug 09 01:31:38 user nova-compute[72780]: INFO nova.compute.manager [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 01:31:38 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:31:38 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:31:39 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Took 1.07 seconds to deallocate network for instance.
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bfda704-1129-496a-8fc4-6adee05d736c req-bd40f443-4a32-4a6c-b5ce-ab8c139e22b0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-vif-deleted-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:31:39 user nova-compute[72780]: INFO nova.compute.manager [req-3bfda704-1129-496a-8fc4-6adee05d736c req-bd40f443-4a32-4a6c-b5ce-ab8c139e22b0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Neutron deleted interface a7ab7086-4000-43ad-92f0-0967bead9f80; detaching it from the instance and deleting it from the info cache
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.network.neutron [req-3bfda704-1129-496a-8fc4-6adee05d736c req-bd40f443-4a32-4a6c-b5ce-ab8c139e22b0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-3bfda704-1129-496a-8fc4-6adee05d736c req-bd40f443-4a32-4a6c-b5ce-ab8c139e22b0 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Detach interface failed, port_id=a7ab7086-4000-43ad-92f0-0967bead9f80, reason: Instance 07e29db5-d679-4196-9e76-1388d7466565 could not be found. {{(pid=72780) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:39 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Deleted allocations for instance 07e29db5-d679-4196-9e76-1388d7466565
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-d89882ac-7a77-433a-bc21-db31cd95fbf6 tempest-SnapshotDataIntegrityTests-1082386859 tempest-SnapshotDataIntegrityTests-1082386859-project-member] Lock "07e29db5-d679-4196-9e76-1388d7466565" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-085f9dac-b677-4bf2-84a1-e72f083e8bb7 req-23ed74c7-5ada-4e1e-b8cf-867c8fd49ba7 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received event network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-085f9dac-b677-4bf2-84a1-e72f083e8bb7 req-23ed74c7-5ada-4e1e-b8cf-867c8fd49ba7 service nova] Acquiring lock "07e29db5-d679-4196-9e76-1388d7466565-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-085f9dac-b677-4bf2-84a1-e72f083e8bb7 req-23ed74c7-5ada-4e1e-b8cf-867c8fd49ba7 service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-085f9dac-b677-4bf2-84a1-e72f083e8bb7 req-23ed74c7-5ada-4e1e-b8cf-867c8fd49ba7 service nova] Lock "07e29db5-d679-4196-9e76-1388d7466565-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:39 user nova-compute[72780]: DEBUG nova.compute.manager [req-085f9dac-b677-4bf2-84a1-e72f083e8bb7 req-23ed74c7-5ada-4e1e-b8cf-867c8fd49ba7 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] No waiting events found dispatching network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:31:39 user nova-compute[72780]: WARNING nova.compute.manager [req-085f9dac-b677-4bf2-84a1-e72f083e8bb7 req-23ed74c7-5ada-4e1e-b8cf-867c8fd49ba7 service nova] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Received unexpected event network-vif-plugged-a7ab7086-4000-43ad-92f0-0967bead9f80 for instance with vm_state deleted and task_state None.
Aug 09 01:31:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:31:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:31:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:31:53 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544698.1826887, 07e29db5-d679-4196-9e76-1388d7466565 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:31:53 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 07e29db5-d679-4196-9e76-1388d7466565] VM Stopped (Lifecycle Event)
Aug 09 01:31:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-00485f2f-de75-45a9-930c-0a9675166ac8 None None] [instance: 07e29db5-d679-4196-9e76-1388d7466565] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:31:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:31:55 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:31:55 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.06024932861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:31:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:31:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:13 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:18 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:32:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:32:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:32:23 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:37 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:32:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:32:37 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 01:32:38 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:32:43 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:48 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:32:50 user nova-compute[72780]: INFO nova.compute.manager [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Unshelving
Aug 09 01:32:50 user nova-compute[72780]: INFO nova.virt.block_device [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Booting with volume 91b274e7-02a8-4b82-b518-cc5e290c4638 at /dev/vda
Aug 09 01:32:50 user nova-compute[72780]: DEBUG os_brick.utils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48cbcbd-ea6e-41cc-abc9-39e341182311]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c3259-912c-4c0c-afba-cb64c5dc85ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b5025c-13dd-439c-babe-5adb247ac177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c9d1b-3fd9-4f0b-8c1d-6db8de5a45a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:32:50 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:32:50 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7ed59-a8c1-4504-b1d6-8ae646078933]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG os_brick.utils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:32:50 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating existing volume attachment record: f3b81147-e264-4141-b9c6-5fcb26fbf586 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:32:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:52 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:32:53 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:32:55 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:32:55 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.05877685546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c1eb1b69-7908-4090-aad0-208e8cf22d71 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:32:55 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:32:57 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'pci_requests' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'numa_topology' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:32:58 user nova-compute[72780]: INFO nova.compute.claims [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Claim successful on node user
Aug 09 01:32:58 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:32:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:32:58 user nova-compute[72780]: INFO nova.network.neutron [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating port 195cdff9-8c70-47cb-9f50-4b2e306698b1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 01:32:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:32:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:32:59 user nova-compute[72780]: DEBUG nova.network.neutron [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:32:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:32:59 user nova-compute[72780]: DEBUG nova.compute.manager [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing instance network info cache due to event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:32:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.network.neutron [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:33:00 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Creating image(s)
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Did not create local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Ensure instance console log exists: /opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Start _get_guest_xml network_info=[{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1eb1b69-7908-4090-aad0-208e8cf22d71', 'attached_at': '', 'detached_at': '', 'volume_id': '91b274e7-02a8-4b82-b518-cc5e290c4638', 'serial': '91b274e7-02a8-4b82-b518-cc5e290c4638'}, 'disk_bus': 'virtio', 'attachment_id': 'f3b81147-e264-4141-b9c6-5fcb26fbf586', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.network.neutron [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:33:00 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:33:00 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'vcpu_model' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:33:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:33:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:33:00 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[015d4fff-8ff1-4d4a-b981-a016db084db0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:33:00 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a06833-cabe-4997-b4a7-815967299cb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638] added
Aug 09 01:33:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7fa4ac-9089-4382-b6a8-249f02e4ffec]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a011a2cc-187e-4c5d-8603-69768c0dc716]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiCaxpDO {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiCaxpDO" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4182888-c239-416f-a7e0-c4fc7dd0e91f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiCaxpDO'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5785d043-21ca-406f-ac98-2228fbe9b2e0]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e6bc1-5a0c-4ebb-9752-113ea91a8dc0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:33:00 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:33:00 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:33:00 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:33:00 user nova-compute[72780]: 
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea8b0f-4d33-44c4-8b5e-545cad36ed70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]
Aug 09 01:33:00 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.
Aug 09 01:33:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486d47d-5e14-4321-835b-dd7c0dfdf06c]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64c7ba4-7078-4f5a-858a-162595775603]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:33:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:33:00 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b20da0-5f81-4de1-8d9b-c0ee59960c9f]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.network.neutron [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated VIF entry in instance network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG nova.network.neutron [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:33:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-270519f5-db13-430a-8cba-3c20fcd381bb req-ec9f035a-1664-4bc6-b590-b797d81833b8 service nova] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23638396636663832', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638396636663832', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1047706793',display_name='tempest-TestShelveInstance-server-1047706793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1047706793',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-582543827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f3c8087caca54d899ce8bd2251c8ea8b',ramdisk_id='',reservation_id='r-z03y1qpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1571414278',owner_user_name='tempest-TestShelveInstance-1571414278-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:32:51Z,user_data=None,user_id='e415eef2a89e4144a8ee0e10528276e1',uuid=c1eb1b69-7908-4090-aad0-208e8cf22d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converting VIF {"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.objects.instance [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'pci_devices' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:33:01 user nova-compute[72780]:   <uuid>c1eb1b69-7908-4090-aad0-208e8cf22d71</uuid>
Aug 09 01:33:01 user nova-compute[72780]:   <name>instance-00000033</name>
Aug 09 01:33:01 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:33:01 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:33:01 user nova-compute[72780]:   <metadata>
Aug 09 01:33:01 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:33:01 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:33:01 user nova-compute[72780]:       <nova:name>tempest-TestShelveInstance-server-1047706793</nova:name>
Aug 09 01:33:01 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:33:00</nova:creationTime>
Aug 09 01:33:01 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:33:01 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:33:01 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:33:01 user nova-compute[72780]:       <nova:owner>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:user uuid="e415eef2a89e4144a8ee0e10528276e1">tempest-TestShelveInstance-1571414278-project-member</nova:user>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:project uuid="f3c8087caca54d899ce8bd2251c8ea8b">tempest-TestShelveInstance-1571414278</nova:project>
Aug 09 01:33:01 user nova-compute[72780]:       </nova:owner>
Aug 09 01:33:01 user nova-compute[72780]:       <nova:ports>
Aug 09 01:33:01 user nova-compute[72780]:         <nova:port uuid="195cdff9-8c70-47cb-9f50-4b2e306698b1">
Aug 09 01:33:01 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 01:33:01 user nova-compute[72780]:         </nova:port>
Aug 09 01:33:01 user nova-compute[72780]:       </nova:ports>
Aug 09 01:33:01 user nova-compute[72780]:     </nova:instance>
Aug 09 01:33:01 user nova-compute[72780]:   </metadata>
Aug 09 01:33:01 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:33:01 user nova-compute[72780]:     <system>
Aug 09 01:33:01 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:33:01 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:33:01 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:33:01 user nova-compute[72780]:       <entry name="serial">c1eb1b69-7908-4090-aad0-208e8cf22d71</entry>
Aug 09 01:33:01 user nova-compute[72780]:       <entry name="uuid">c1eb1b69-7908-4090-aad0-208e8cf22d71</entry>
Aug 09 01:33:01 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:33:01 user nova-compute[72780]:     </system>
Aug 09 01:33:01 user nova-compute[72780]:   </sysinfo>
Aug 09 01:33:01 user nova-compute[72780]:   <os>
Aug 09 01:33:01 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:33:01 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:33:01 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:33:01 user nova-compute[72780]:   </os>
Aug 09 01:33:01 user nova-compute[72780]:   <features>
Aug 09 01:33:01 user nova-compute[72780]:     <acpi/>
Aug 09 01:33:01 user nova-compute[72780]:     <apic/>
Aug 09 01:33:01 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:33:01 user nova-compute[72780]:   </features>
Aug 09 01:33:01 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:33:01 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:33:01 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:33:01 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:33:01 user nova-compute[72780]:   </clock>
Aug 09 01:33:01 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:33:01 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:33:01 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:33:01 user nova-compute[72780]:   </cpu>
Aug 09 01:33:01 user nova-compute[72780]:   <devices>
Aug 09 01:33:01 user nova-compute[72780]:     <disk type="block" device="disk">
Aug 09 01:33:01 user nova-compute[72780]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:33:01 user nova-compute[72780]:       <source dev="/dev/sdb"/>
Aug 09 01:33:01 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:33:01 user nova-compute[72780]:       <serial>91b274e7-02a8-4b82-b518-cc5e290c4638</serial>
Aug 09 01:33:01 user nova-compute[72780]:     </disk>
Aug 09 01:33:01 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:33:01 user nova-compute[72780]:       <mac address="fa:16:3e:3b:f5:cd"/>
Aug 09 01:33:01 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:33:01 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:33:01 user nova-compute[72780]:       <target dev="tap195cdff9-8c"/>
Aug 09 01:33:01 user nova-compute[72780]:     </interface>
Aug 09 01:33:01 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:33:01 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71/console.log" append="off"/>
Aug 09 01:33:01 user nova-compute[72780]:     </serial>
Aug 09 01:33:01 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:33:01 user nova-compute[72780]:     <video>
Aug 09 01:33:01 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:33:01 user nova-compute[72780]:     </video>
Aug 09 01:33:01 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:33:01 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:33:01 user nova-compute[72780]:     </rng>
Aug 09 01:33:01 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:33:01 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:33:01 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:33:01 user nova-compute[72780]:     </memballoon>
Aug 09 01:33:01 user nova-compute[72780]:   </devices>
Aug 09 01:33:01 user nova-compute[72780]: </domain>
Aug 09 01:33:01 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1047706793',display_name='tempest-TestShelveInstance-server-1047706793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1047706793',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-582543827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f3c8087caca54d899ce8bd2251c8ea8b',ramdisk_id='',reservation_id='r-z03y1qpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1571414278',owner_user_name='tempest-TestShelveInstance-1571414278-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:32:51Z,user_data=None,user_id='e415eef2a89e4144a8ee0e10528276e1',uuid=c1eb1b69-7908-4090-aad0-208e8cf22d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converting VIF {"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG os_vif [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195cdff9-8c, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap195cdff9-8c, col_values=(('external_ids', {'iface-id': '195cdff9-8c70-47cb-9f50-4b2e306698b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f5:cd', 'vm-uuid': 'c1eb1b69-7908-4090-aad0-208e8cf22d71'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:01 user nova-compute[72780]: INFO os_vif [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c')
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:33:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] No VIF found with MAC fa:16:3e:3b:f5:cd, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:33:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-c018a7d9-3127-44a6-a2b2-2882fde3754c req-d7488942-e7c5-44fc-a8c3-0118c045d996 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c018a7d9-3127-44a6-a2b2-2882fde3754c req-d7488942-e7c5-44fc-a8c3-0118c045d996 service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c018a7d9-3127-44a6-a2b2-2882fde3754c req-d7488942-e7c5-44fc-a8c3-0118c045d996 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c018a7d9-3127-44a6-a2b2-2882fde3754c req-d7488942-e7c5-44fc-a8c3-0118c045d996 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG nova.compute.manager [req-c018a7d9-3127-44a6-a2b2-2882fde3754c req-d7488942-e7c5-44fc-a8c3-0118c045d996 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:33:03 user nova-compute[72780]: WARNING nova.compute.manager [req-c018a7d9-3127-44a6-a2b2-2882fde3754c req-d7488942-e7c5-44fc-a8c3-0118c045d996 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 01:33:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:03 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544784.8256936, c1eb1b69-7908-4090-aad0-208e8cf22d71 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:33:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] VM Resumed (Lifecycle Event)
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:33:04 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance spawned successfully.
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:33:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544784.8271706, c1eb1b69-7908-4090-aad0-208e8cf22d71 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:33:04 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] VM Started (Lifecycle Event)
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:33:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:33:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-e6596584-3c42-4eed-ad83-0a6cf3924589 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.359s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:33:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-f7bca823-56e5-429b-8a82-53fb7ced3df9 req-1d5a289b-f824-4744-887f-6fcd07b37b8e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:33:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f7bca823-56e5-429b-8a82-53fb7ced3df9 req-1d5a289b-f824-4744-887f-6fcd07b37b8e service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:33:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f7bca823-56e5-429b-8a82-53fb7ced3df9 req-1d5a289b-f824-4744-887f-6fcd07b37b8e service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:33:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-f7bca823-56e5-429b-8a82-53fb7ced3df9 req-1d5a289b-f824-4744-887f-6fcd07b37b8e service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:33:05 user nova-compute[72780]: DEBUG nova.compute.manager [req-f7bca823-56e5-429b-8a82-53fb7ced3df9 req-1d5a289b-f824-4744-887f-6fcd07b37b8e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:33:05 user nova-compute[72780]: WARNING nova.compute.manager [req-f7bca823-56e5-429b-8a82-53fb7ced3df9 req-1d5a289b-f824-4744-887f-6fcd07b37b8e service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state active and task_state None.
Aug 09 01:33:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:10 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:24 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:33:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:33:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:33:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:33:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:33:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:33:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:33:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:33:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:33:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:54 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72780) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:33:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:33:56 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=25.05733871459961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance c1eb1b69-7908-4090-aad0-208e8cf22d71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:33:56 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:33:57 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:33:57 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:33:57 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:33:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:33:59 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:34:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:34:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:34:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:34:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:34:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:34:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:34:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:34:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:34:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:39 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:34:40 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG nova.compute.manager [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing instance network info cache due to event network-changed-195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] Acquiring lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] Acquired lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG nova.network.neutron [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Refreshing network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:34:41 user nova-compute[72780]: INFO nova.compute.manager [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Terminating instance
Aug 09 01:34:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-d2f2671d-e091-4cf2-93e3-2964efeda8da req-1783c484-413b-4e85-b64f-d64d3e14e5bd service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-unplugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d2f2671d-e091-4cf2-93e3-2964efeda8da req-1783c484-413b-4e85-b64f-d64d3e14e5bd service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d2f2671d-e091-4cf2-93e3-2964efeda8da req-1783c484-413b-4e85-b64f-d64d3e14e5bd service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-d2f2671d-e091-4cf2-93e3-2964efeda8da req-1783c484-413b-4e85-b64f-d64d3e14e5bd service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-d2f2671d-e091-4cf2-93e3-2964efeda8da req-1783c484-413b-4e85-b64f-d64d3e14e5bd service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-unplugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.compute.manager [req-d2f2671d-e091-4cf2-93e3-2964efeda8da req-1783c484-413b-4e85-b64f-d64d3e14e5bd service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-unplugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:34:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Instance destroyed successfully.
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.objects.instance [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lazy-loading 'resources' on Instance uuid c1eb1b69-7908-4090-aad0-208e8cf22d71 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T01:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1047706793',display_name='tempest-TestShelveInstance-server-1047706793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1047706793',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOXLOQzi/crzTxTn7fJ2ut+0fDmEVG7P3PqYSBWokObu3U0YPG1fyil8HFggMPO0+gYNF9Hk7cGqmbiRW1ATvPxt+FxXVBz0vRT/7Pg2iZBBkN5A8a5DaE/trb6yHootA==',key_name='tempest-TestShelveInstance-582543827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:33:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c8087caca54d899ce8bd2251c8ea8b',ramdisk_id='',reservation_id='r-z03y1qpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1571414278',owner_user_name='tempest-TestShelveInstance-1571414278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:33:05Z,user_data=None,user_id='e415eef2a89e4144a8ee0e10528276e1',uuid=c1eb1b69-7908-4090-aad0-208e8cf22d71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converting VIF {"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_vif [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195cdff9-8c, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:42 user nova-compute[72780]: INFO os_vif [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f5:cd,bridge_name='br-int',has_traffic_filtering=True,id=195cdff9-8c70-47cb-9f50-4b2e306698b1,network=Network(fff26f69-c6d0-4eba-8215-3848031f28ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195cdff9-8c')
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiCaxpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:34:42 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f5f7a1-4481-44e1-9f07-9a1a5983290f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.network.neutron [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updated VIF entry in instance network info cache for port 195cdff9-8c70-47cb-9f50-4b2e306698b1. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.network.neutron [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [{"id": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "address": "fa:16:3e:3b:f5:cd", "network": {"id": "fff26f69-c6d0-4eba-8215-3848031f28ad", "bridge": "br-int", "label": "tempest-TestShelveInstance-287902239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c8087caca54d899ce8bd2251c8ea8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195cdff9-8c", "ovs_interfaceid": "195cdff9-8c70-47cb-9f50-4b2e306698b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514162d-e2cd-4c85-856c-e1b42b97d8ec]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:34:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 (non-flash)
Aug 09 01:34:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0179ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-4c431bed-779c-4966-998a-27408f53e9b1 req-60a51442-caf1-469e-a67e-05f4ecb847e2 service nova] Releasing lock "refresh_cache-c1eb1b69-7908-4090-aad0-208e8cf22d71" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d322b3-f448-4c19-a82f-a3238528ae4f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d5e39-fbfc-4b66-b017-578817213f78]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c2d8a-1c7f-4315-a45d-edad8faa7428]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1f352-5271-4356-acb1-b7433ea2ca15]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9f480609-689f6f82c4d62ab0', '/dev/disk/by-id/scsi-23638396636663832', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9f480609') {{(pid=83773) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc8cc3-3393-4503-8fea-d94455cf9345]: (4, None) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[47578faa-51c3-41c0-a363-cd288a011b13]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a51bddd-e220-4b37-ab00-4bc36c82c253]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260]
Aug 09 01:34:42 user nova-compute[72780]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638, portal: 172.16.0.220,3260] successful.
Aug 09 01:34:42 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b274e7-02a8-4b82-b518-cc5e290c4638 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbd0923-c4f1-4bc7-acc2-c097d05617b3]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] <== disconnect_volume: return (280ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:34:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Deleting instance files /opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71_del
Aug 09 01:34:42 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Deletion of /opt/stack/data/nova/instances/c1eb1b69-7908-4090-aad0-208e8cf22d71_del complete
Aug 09 01:34:42 user nova-compute[72780]: INFO nova.compute.manager [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 01:34:42 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:34:42 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:34:43 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:34:43 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Took 0.95 seconds to deallocate network for instance.
Aug 09 01:34:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] Acquiring lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] No waiting events found dispatching network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:34:44 user nova-compute[72780]: WARNING nova.compute.manager [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received unexpected event network-vif-plugged-195cdff9-8c70-47cb-9f50-4b2e306698b1 for instance with vm_state active and task_state deleting.
Aug 09 01:34:44 user nova-compute[72780]: DEBUG nova.compute.manager [req-6f500a8c-6189-439b-a294-14344d33ea44 req-8f63fa5c-4c52-4f1b-9890-94250acfb607 service nova] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Received event network-vif-deleted-195cdff9-8c70-47cb-9f50-4b2e306698b1 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:34:44 user nova-compute[72780]: INFO nova.compute.manager [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Took 0.77 seconds to detach 1 volumes for instance.
Aug 09 01:34:44 user nova-compute[72780]: DEBUG nova.compute.manager [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Deleting volume: 91b274e7-02a8-4b82-b518-cc5e290c4638 {{(pid=72780) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:34:44 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Deleted allocations for instance c1eb1b69-7908-4090-aad0-208e8cf22d71
Aug 09 01:34:44 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-36bd111c-424b-439f-b3a1-5a6be704b795 tempest-TestShelveInstance-1571414278 tempest-TestShelveInstance-1571414278-project-member] Lock "c1eb1b69-7908-4090-aad0-208e8cf22d71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.271s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:34:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:48 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:54 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:54 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:34:57 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691544882.284242, c1eb1b69-7908-4090-aad0-208e8cf22d71 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:34:57 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] VM Stopped (Lifecycle Event)
Aug 09 01:34:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-8b80795c-f1f4-4a15-89d0-ff1419384ddc None None] [instance: c1eb1b69-7908-4090-aad0-208e8cf22d71] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:34:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:34:58 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:34:58 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=25.05652618408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:34:58 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:35:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:35:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:35:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:35:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:35:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:35:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:35:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:35:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:35:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:35:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:35:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:35:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:33 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:34 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:37 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:38 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:35:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:35:41 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 01:35:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:42 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:47 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:52 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:52 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:35:54 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:56 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:56 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:35:57 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:35:59 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:35:59 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=25.055194854736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:35:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:01 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:36:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:36:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:36:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:36:02 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:36:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:07 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:08 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:12 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:14 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:15 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:17 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:22 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Starting instance... {{(pid=72780) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72780) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 01:36:23 user nova-compute[72780]: INFO nova.compute.claims [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Claim successful on node user
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Start building networks asynchronously for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Allocating IP information in the background. {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.network.neutron [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] allocate_for_instance() {{(pid=72780) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 01:36:23 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 01:36:23 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Start building block device mappings for instance. {{(pid=72780) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG nova.policy [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c344777e6f5c4a65970668707bd2a1a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9b52dce7ac465885f05713644683ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72780) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Start spawning the instance on the hypervisor. {{(pid=72780) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Creating instance directory {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 01:36:24 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Creating image(s)
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "/opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "/opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.179s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk 1073741824 {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64,backing_fmt=raw /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk 1073741824" returned: 0 in 0.066s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "69f652d7bffd7345fdf9fe2f554ae7811aaf7c64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69f652d7bffd7345fdf9fe2f554ae7811aaf7c64 --force-share --output=json" returned: 0 in 0.151s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk. size=1073741824 {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG nova.virt.disk.api [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Cannot resize image /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk to a smaller size. {{(pid=72780) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 01:36:24 user nova-compute[72780]: DEBUG nova.objects.instance [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'migration_context' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Created local disks {{(pid=72780) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Ensure instance console log exists: /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/console.log {{(pid=72780) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Successfully created port: 229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Successfully updated port: 229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:36:25 user nova-compute[72780]: DEBUG nova.network.neutron [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Building network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-changed-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.compute.manager [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Refreshing instance network info cache due to event network-changed-229f28d9-9bf5-4668-b0d9-ebac622e05c8. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.neutron [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Instance cache missing network info. {{(pid=72780) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.neutron [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Instance network_info: |[{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72780) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.neutron [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Refreshing network info cache for port 229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Start _get_guest_xml network_info=[{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'f43f2d4e-45ef-42ce-9cde-789adcfd9b22'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 01:36:26 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:36:26 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CPU controller missing on host. {{(pid=72780) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.host [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CPU controller found on host. {{(pid=72780) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72780) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T00:47:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T00:47:33Z,direct_url=<?>,disk_format='qcow2',id=f43f2d4e-45ef-42ce-9cde-789adcfd9b22,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b9aa823b8b2e46f8907e8be435bd146d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T00:47:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Flavor limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Image limits 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Flavor pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Image pref 0:0:0 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Got 1 possible topologies {{(pid=72780) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.hardware [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72780) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1061233848',display_name='tempest-SnapshotDataIntegrityTests-server-1061233848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1061233848',id=52,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3U/08nfyGumIvvb323PVITNL0sWVHUqqT2zciG8DCARaaRRDBqVWJtv7LfuEGMzToGnYzLSMJ1fZQXdUx7c+ioco7H3VuWQfK4/3NtYPA1WHDc/Cxvau14TDYK5kIVNA==',key_name='tempest-keypair-1323640319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a9b52dce7ac465885f05713644683ae',ramdisk_id='',reservation_id='r-e57z0vs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-549058555',owner_user_name='tempest-SnapshotDataIntegrityTests-549058555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c344777e6f5c4a65970668707bd2a1a5',uuid=5cb45fc5-ca72-442e-8e40-286e49680977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72780) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Converting VIF {"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.objects.instance [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] End _get_guest_xml xml=<domain type="kvm">
Aug 09 01:36:26 user nova-compute[72780]:   <uuid>5cb45fc5-ca72-442e-8e40-286e49680977</uuid>
Aug 09 01:36:26 user nova-compute[72780]:   <name>instance-00000034</name>
Aug 09 01:36:26 user nova-compute[72780]:   <memory>524288</memory>
Aug 09 01:36:26 user nova-compute[72780]:   <vcpu>1</vcpu>
Aug 09 01:36:26 user nova-compute[72780]:   <metadata>
Aug 09 01:36:26 user nova-compute[72780]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 01:36:26 user nova-compute[72780]:       <nova:package version="0.0.0"/>
Aug 09 01:36:26 user nova-compute[72780]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1061233848</nova:name>
Aug 09 01:36:26 user nova-compute[72780]:       <nova:creationTime>2023-08-09 01:36:26</nova:creationTime>
Aug 09 01:36:26 user nova-compute[72780]:       <nova:flavor name="m1.tiny">
Aug 09 01:36:26 user nova-compute[72780]:         <nova:memory>512</nova:memory>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:disk>1</nova:disk>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:swap>0</nova:swap>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:vcpus>1</nova:vcpus>
Aug 09 01:36:26 user nova-compute[72780]:       </nova:flavor>
Aug 09 01:36:26 user nova-compute[72780]:       <nova:owner>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:user uuid="c344777e6f5c4a65970668707bd2a1a5">tempest-SnapshotDataIntegrityTests-549058555-project-member</nova:user>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:project uuid="8a9b52dce7ac465885f05713644683ae">tempest-SnapshotDataIntegrityTests-549058555</nova:project>
Aug 09 01:36:26 user nova-compute[72780]:       </nova:owner>
Aug 09 01:36:26 user nova-compute[72780]:       <nova:root type="image" uuid="f43f2d4e-45ef-42ce-9cde-789adcfd9b22"/>
Aug 09 01:36:26 user nova-compute[72780]:       <nova:ports>
Aug 09 01:36:26 user nova-compute[72780]:         <nova:port uuid="229f28d9-9bf5-4668-b0d9-ebac622e05c8">
Aug 09 01:36:26 user nova-compute[72780]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 01:36:26 user nova-compute[72780]:         </nova:port>
Aug 09 01:36:26 user nova-compute[72780]:       </nova:ports>
Aug 09 01:36:26 user nova-compute[72780]:     </nova:instance>
Aug 09 01:36:26 user nova-compute[72780]:   </metadata>
Aug 09 01:36:26 user nova-compute[72780]:   <sysinfo type="smbios">
Aug 09 01:36:26 user nova-compute[72780]:     <system>
Aug 09 01:36:26 user nova-compute[72780]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 01:36:26 user nova-compute[72780]:       <entry name="product">OpenStack Nova</entry>
Aug 09 01:36:26 user nova-compute[72780]:       <entry name="version">0.0.0</entry>
Aug 09 01:36:26 user nova-compute[72780]:       <entry name="serial">5cb45fc5-ca72-442e-8e40-286e49680977</entry>
Aug 09 01:36:26 user nova-compute[72780]:       <entry name="uuid">5cb45fc5-ca72-442e-8e40-286e49680977</entry>
Aug 09 01:36:26 user nova-compute[72780]:       <entry name="family">Virtual Machine</entry>
Aug 09 01:36:26 user nova-compute[72780]:     </system>
Aug 09 01:36:26 user nova-compute[72780]:   </sysinfo>
Aug 09 01:36:26 user nova-compute[72780]:   <os>
Aug 09 01:36:26 user nova-compute[72780]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 01:36:26 user nova-compute[72780]:     <boot dev="hd"/>
Aug 09 01:36:26 user nova-compute[72780]:     <smbios mode="sysinfo"/>
Aug 09 01:36:26 user nova-compute[72780]:   </os>
Aug 09 01:36:26 user nova-compute[72780]:   <features>
Aug 09 01:36:26 user nova-compute[72780]:     <acpi/>
Aug 09 01:36:26 user nova-compute[72780]:     <apic/>
Aug 09 01:36:26 user nova-compute[72780]:     <vmcoreinfo/>
Aug 09 01:36:26 user nova-compute[72780]:   </features>
Aug 09 01:36:26 user nova-compute[72780]:   <clock offset="utc">
Aug 09 01:36:26 user nova-compute[72780]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 01:36:26 user nova-compute[72780]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 01:36:26 user nova-compute[72780]:     <timer name="hpet" present="no"/>
Aug 09 01:36:26 user nova-compute[72780]:   </clock>
Aug 09 01:36:26 user nova-compute[72780]:   <cpu mode="custom" match="exact">
Aug 09 01:36:26 user nova-compute[72780]:     <model>Nehalem</model>
Aug 09 01:36:26 user nova-compute[72780]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 01:36:26 user nova-compute[72780]:   </cpu>
Aug 09 01:36:26 user nova-compute[72780]:   <devices>
Aug 09 01:36:26 user nova-compute[72780]:     <disk type="file" device="disk">
Aug 09 01:36:26 user nova-compute[72780]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 01:36:26 user nova-compute[72780]:       <source file="/opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk"/>
Aug 09 01:36:26 user nova-compute[72780]:       <target dev="vda" bus="virtio"/>
Aug 09 01:36:26 user nova-compute[72780]:     </disk>
Aug 09 01:36:26 user nova-compute[72780]:     <interface type="ethernet">
Aug 09 01:36:26 user nova-compute[72780]:       <mac address="fa:16:3e:ec:8b:82"/>
Aug 09 01:36:26 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:36:26 user nova-compute[72780]:       <mtu size="1442"/>
Aug 09 01:36:26 user nova-compute[72780]:       <target dev="tap229f28d9-9b"/>
Aug 09 01:36:26 user nova-compute[72780]:     </interface>
Aug 09 01:36:26 user nova-compute[72780]:     <serial type="pty">
Aug 09 01:36:26 user nova-compute[72780]:       <log file="/opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/console.log" append="off"/>
Aug 09 01:36:26 user nova-compute[72780]:     </serial>
Aug 09 01:36:26 user nova-compute[72780]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 01:36:26 user nova-compute[72780]:     <video>
Aug 09 01:36:26 user nova-compute[72780]:       <model type="virtio"/>
Aug 09 01:36:26 user nova-compute[72780]:     </video>
Aug 09 01:36:26 user nova-compute[72780]:     <rng model="virtio">
Aug 09 01:36:26 user nova-compute[72780]:       <backend model="random">/dev/urandom</backend>
Aug 09 01:36:26 user nova-compute[72780]:     </rng>
Aug 09 01:36:26 user nova-compute[72780]:     <controller type="usb" index="0" model="none"/>
Aug 09 01:36:26 user nova-compute[72780]:     <memballoon model="virtio">
Aug 09 01:36:26 user nova-compute[72780]:       <stats period="10"/>
Aug 09 01:36:26 user nova-compute[72780]:     </memballoon>
Aug 09 01:36:26 user nova-compute[72780]:   </devices>
Aug 09 01:36:26 user nova-compute[72780]: </domain>
Aug 09 01:36:26 user nova-compute[72780]:  {{(pid=72780) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1061233848',display_name='tempest-SnapshotDataIntegrityTests-server-1061233848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1061233848',id=52,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3U/08nfyGumIvvb323PVITNL0sWVHUqqT2zciG8DCARaaRRDBqVWJtv7LfuEGMzToGnYzLSMJ1fZQXdUx7c+ioco7H3VuWQfK4/3NtYPA1WHDc/Cxvau14TDYK5kIVNA==',key_name='tempest-keypair-1323640319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a9b52dce7ac465885f05713644683ae',ramdisk_id='',reservation_id='r-e57z0vs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-549058555',owner_user_name='tempest-SnapshotDataIntegrityTests-549058555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T01:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c344777e6f5c4a65970668707bd2a1a5',uuid=5cb45fc5-ca72-442e-8e40-286e49680977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Converting VIF {"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG os_vif [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b') {{(pid=72780) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap229f28d9-9b, may_exist=True, interface_attrs={}) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap229f28d9-9b, col_values=(('external_ids', {'iface-id': '229f28d9-9bf5-4668-b0d9-ebac622e05c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:8b:82', 'vm-uuid': '5cb45fc5-ca72-442e-8e40-286e49680977'}),), if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:26 user nova-compute[72780]: INFO os_vif [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b')
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:36:26 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No VIF found with MAC fa:16:3e:ec:8b:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:36:27 user nova-compute[72780]: DEBUG nova.network.neutron [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated VIF entry in instance network info cache for port 229f28d9-9bf5-4668-b0d9-ebac622e05c8. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:36:27 user nova-compute[72780]: DEBUG nova.network.neutron [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:36:27 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-765c2b7c-703e-443e-99a4-372038023968 req-e9c8723f-d4ca-4aeb-b0be-ffbfb9ee84f2 service nova] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:36:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:27 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2a0bf32-c6d7-4a7f-a8ed-29ef06b4fab8 req-551e5dc2-7f90-4d25-b84c-42de2b195edb service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2a0bf32-c6d7-4a7f-a8ed-29ef06b4fab8 req-551e5dc2-7f90-4d25-b84c-42de2b195edb service nova] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2a0bf32-c6d7-4a7f-a8ed-29ef06b4fab8 req-551e5dc2-7f90-4d25-b84c-42de2b195edb service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-a2a0bf32-c6d7-4a7f-a8ed-29ef06b4fab8 req-551e5dc2-7f90-4d25-b84c-42de2b195edb service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG nova.compute.manager [req-a2a0bf32-c6d7-4a7f-a8ed-29ef06b4fab8 req-551e5dc2-7f90-4d25-b84c-42de2b195edb service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] No waiting events found dispatching network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:36:28 user nova-compute[72780]: WARNING nova.compute.manager [req-a2a0bf32-c6d7-4a7f-a8ed-29ef06b4fab8 req-551e5dc2-7f90-4d25-b84c-42de2b195edb service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received unexpected event network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 for instance with vm_state building and task_state spawning.
Aug 09 01:36:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:28 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-69b971d3-5378-47ad-9c1b-2c286b59d6a5 req-43be8b00-c7ac-466f-b466-3f0ed981e6e8 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-69b971d3-5378-47ad-9c1b-2c286b59d6a5 req-43be8b00-c7ac-466f-b466-3f0ed981e6e8 service nova] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-69b971d3-5378-47ad-9c1b-2c286b59d6a5 req-43be8b00-c7ac-466f-b466-3f0ed981e6e8 service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-69b971d3-5378-47ad-9c1b-2c286b59d6a5 req-43be8b00-c7ac-466f-b466-3f0ed981e6e8 service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [req-69b971d3-5378-47ad-9c1b-2c286b59d6a5 req-43be8b00-c7ac-466f-b466-3f0ed981e6e8 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] No waiting events found dispatching network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:36:30 user nova-compute[72780]: WARNING nova.compute.manager [req-69b971d3-5378-47ad-9c1b-2c286b59d6a5 req-43be8b00-c7ac-466f-b466-3f0ed981e6e8 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received unexpected event network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 for instance with vm_state building and task_state spawning.
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544990.554971, 5cb45fc5-ca72-442e-8e40-286e49680977 => Resumed> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] VM Resumed (Lifecycle Event)
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Instance event wait completed in 0 seconds for  {{(pid=72780) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Guest created on hypervisor {{(pid=72780) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Instance spawned successfully.
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Found default for hw_cdrom_bus of ide {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Found default for hw_disk_bus of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Found default for hw_input_bus of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Found default for hw_pointer_model of None {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Found default for hw_video_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Found default for hw_vif_model of virtio {{(pid=72780) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.virt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Emitting event <LifecycleEvent: 1691544990.5586612, 5cb45fc5-ca72-442e-8e40-286e49680977 => Started> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] VM Started (Lifecycle Event)
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72780) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.compute.manager [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 09 01:36:30 user nova-compute[72780]: DEBUG nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:36:30 user nova-compute[72780]: INFO nova.compute.manager [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Took 7.27 seconds to build instance.
Aug 09 01:36:30 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-05370280-e237-45cd-a17d-643401752762 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.388s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:36:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:36:43 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:54 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:56 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:36:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:36:58 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:37:00 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:37:01 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:37:01 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=25.011558532714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:37:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:37:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:37:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:37:45 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:37:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:37:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:50 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:37:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:55 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:37:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:02 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:38:02 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:38:02 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.00101089477539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:38:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:38:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:38:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-changed-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:38:14 user nova-compute[72780]: DEBUG nova.compute.manager [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Refreshing instance network info cache due to event network-changed-229f28d9-9bf5-4668-b0d9-ebac622e05c8. {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 01:38:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:38:14 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:38:14 user nova-compute[72780]: DEBUG nova.network.neutron [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Refreshing network info cache for port 229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 01:38:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated VIF entry in instance network info cache for port 229f28d9-9bf5-4668-b0d9-ebac622e05c8. {{(pid=72780) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 01:38:15 user nova-compute[72780]: DEBUG nova.network.neutron [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:38:15 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-91124423-4ca3-4241-b559-ea6c71d0f44b req-e635d98a-5d29-4345-abfe-04f13f78d30e service nova] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:38:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:38:19 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:38:19 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:38:20 user nova-compute[72780]: INFO nova.compute.manager [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attaching volume 67a09b66-cd20-49b2-be2a-4be99b7609a0 to /dev/vdb
Aug 09 01:38:20 user nova-compute[72780]: DEBUG os_brick.utils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a26b09-8f85-4f54-ba26-213325bffdae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742063a-86cd-4cd7-a117-dd5ba6ded190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55282cf-6487-411d-b934-c76b59ef33d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c332d04-ba1a-4d5e-accb-bedb79989a50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:38:20 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:38:20 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[242e916e-3d8c-4f18-8802-0fbe7bd7cfba]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG os_brick.utils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:38:20 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating existing volume attachment record: d0ddb9aa-d757-48d7-9580-393d519c702d {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:38:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptNQHnsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:38:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:38:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:38:27 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82bb3d5-ad86-4839-8a9f-fad8f300fa0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:38:27 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1134bcec-7db9-4e66-a6b3-734a8d8bc251]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0] added
Aug 09 01:38:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a66073-6e59-4756-923e-25304c12f4f8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c600986-5207-45f9-b2a3-ee70aeb0ac8b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptNQHnsc {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptNQHnsc" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbf07e9-f13a-4efa-b7d5-21702cf80646]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptNQHnsc'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927de31-9d8d-4755-997f-18ca524c8c00]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b132d1-013c-407c-a077-4110e89faff1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:38:27 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:38:27 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:38:27 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:38:27 user nova-compute[72780]: 
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b9c7d-4497-44ca-95a9-8d73d5ce3058]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260]
Aug 09 01:38:27 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260] successful.
Aug 09 01:38:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96b382-f199-4493-8306-0182f41a2bd4]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeefaac0-db2c-4a81-8e95-1920abb23bf8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 (non-flash)
Aug 09 01:38:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 (non-flash)
Aug 09 01:38:27 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0eabae-2a8e-40ba-bb4f-994dca8d6385]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:27 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptNQHnsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23163313338643030', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163313338643030', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:38:28 user nova-compute[72780]: DEBUG nova.objects.instance [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:38:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:38:29 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:38:29 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:38:29 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:38:29 user nova-compute[72780]:   <serial>67a09b66-cd20-49b2-be2a-4be99b7609a0</serial>
Aug 09 01:38:29 user nova-compute[72780]: </disk>
Aug 09 01:38:29 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:38:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:38:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:38:29 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No VIF found with MAC fa:16:3e:ec:8b:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:38:29 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-4e546302-0be5-4aec-b8aa-c95f13e96d4d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.493s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:38:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:38:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:38:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:38:52 user nova-compute[72780]: INFO nova.compute.manager [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Detaching volume 67a09b66-cd20-49b2-be2a-4be99b7609a0
Aug 09 01:38:52 user nova-compute[72780]: INFO nova.virt.block_device [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attempting to driver detach volume 67a09b66-cd20-49b2-be2a-4be99b7609a0 from mountpoint /dev/vdb
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Attempting to detach device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:38:52 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:38:52 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:38:52 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:38:52 user nova-compute[72780]:   <serial>67a09b66-cd20-49b2-be2a-4be99b7609a0</serial>
Aug 09 01:38:52 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:38:52 user nova-compute[72780]: </disk>
Aug 09 01:38:52 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:38:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config.
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:38:52 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:38:52 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:38:52 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:38:52 user nova-compute[72780]:   <serial>67a09b66-cd20-49b2-be2a-4be99b7609a0</serial>
Aug 09 01:38:52 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:38:52 user nova-compute[72780]: </disk>
Aug 09 01:38:52 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691545132.7488725, 5cb45fc5-ca72-442e-8e40-286e49680977 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:38:52 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config.
Aug 09 01:38:52 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptNQHnsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:38:52 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdf7ea9-9b99-448b-b3cd-a489d236bbe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f459569c-7e14-444d-be6d-1aa2581d2c95]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 (non-flash)
Aug 09 01:38:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 (non-flash)
Aug 09 01:38:52 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0232290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065d9d3-f728-4363-b437-98b6a2f6c376]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9341c0e-a095-4341-a5d8-e8b1d05e2546]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eaefc9-6d48-4e89-b1eb-ceb6c01a6ae6]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2195991-926d-421f-8704-4af46420995a]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2a058-f4de-45e3-b218-a1da73b2aae1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2521a6-914e-4fcc-a1ff-e65c87d0f20e]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260]
Aug 09 01:38:53 user nova-compute[72780]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0, portal: 172.16.0.220,3260] successful.
Aug 09 01:38:53 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a09b66-cd20-49b2-be2a-4be99b7609a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba25cfa-3330-4a73-9c4f-aad13868f5a1]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== disconnect_volume: return (278ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG nova.objects.instance [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:38:53 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-3cf96cd7-8e37-4ad5-ae6e-c8a5ac432993 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:38:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:38:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:00 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:39:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:02 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:39:02 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:39:02 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.999408721923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:39:02 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:39:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:39:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:07 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Triggering sync for uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 01:39:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:39:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:39:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:39:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:39:46 user nova-compute[72780]: INFO nova.compute.manager [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attaching volume 1a2f1340-dd30-4b34-96f1-78ec3be39c2a to /dev/vdb
Aug 09 01:39:46 user nova-compute[72780]: DEBUG os_brick.utils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb05dc14-f3af-4797-8721-f0f72485b5d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2024c8-b444-4d97-bc62-9760361da397]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf371d9-1dfa-482f-b5cd-b75b167b9cf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e152c5b5-7eeb-469e-aeed-dcbb0ab7ab27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:39:46 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:39:46 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ebb35-7690-4bac-b67a-a50950245cfe]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG os_brick.utils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating existing volume attachment record: 1b784921-0df0-436a-a600-47061c2f3c8b {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:39:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:39:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:39:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXfsyYGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:39:54 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:39:54 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:39:54 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b506459-c992-4f41-bcb1-a23411168e1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:39:54 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[470fba41-bd30-458e-b604-244cc303ce5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a] added
Aug 09 01:39:54 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608ed37-c2be-49e0-9f7c-84d59a2542c8]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[205f17a7-ad96-403b-9fb0-d0acdfa6b351]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXfsyYGF {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXfsyYGF" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb1ee77-bab5-4527-a8c7-1c1a346c657b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXfsyYGF'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57848dd-a8ee-4216-a223-7603908d3756]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7dd7a3-74e3-4698-a5b4-e5188422d45e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:39:54 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:39:54 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:39:54 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:39:54 user nova-compute[72780]: 
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f9be0b-7342-4f87-87dd-69075efff182]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260]
Aug 09 01:39:54 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260] successful.
Aug 09 01:39:54 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5fe32-61c9-4ef8-b96a-20c536aef8c7]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3041c-76e0-4262-957b-b273427f8345]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a (non-flash)
Aug 09 01:39:54 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a (non-flash)
Aug 09 01:39:54 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[826000cf-2987-42e8-a661-5630da3907fa]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:39:54 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXfsyYGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23766393931653632', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766393931653632', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG nova.objects.instance [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:39:55 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:39:55 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:39:55 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:39:55 user nova-compute[72780]:   <serial>1a2f1340-dd30-4b34-96f1-78ec3be39c2a</serial>
Aug 09 01:39:55 user nova-compute[72780]: </disk>
Aug 09 01:39:55 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:39:55 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No VIF found with MAC fa:16:3e:ec:8b:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-8e45829d-c6b3-4952-b0ad-b92a159fe56d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.538s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:39:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:39:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:39:57 user nova-compute[72780]: INFO nova.compute.manager [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Detaching volume 1a2f1340-dd30-4b34-96f1-78ec3be39c2a
Aug 09 01:39:57 user nova-compute[72780]: INFO nova.virt.block_device [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attempting to driver detach volume 1a2f1340-dd30-4b34-96f1-78ec3be39c2a from mountpoint /dev/vdb
Aug 09 01:39:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Attempting to detach device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:39:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:39:57 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:39:57 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:39:57 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:39:57 user nova-compute[72780]:   <serial>1a2f1340-dd30-4b34-96f1-78ec3be39c2a</serial>
Aug 09 01:39:57 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:39:57 user nova-compute[72780]: </disk>
Aug 09 01:39:57 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:39:57 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config.
Aug 09 01:39:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:39:57 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:39:57 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:39:57 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:39:57 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:39:57 user nova-compute[72780]:   <serial>1a2f1340-dd30-4b34-96f1-78ec3be39c2a</serial>
Aug 09 01:39:57 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:39:57 user nova-compute[72780]: </disk>
Aug 09 01:39:57 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691545198.3746166, 5cb45fc5-ca72-442e-8e40-286e49680977 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:39:58 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config.
Aug 09 01:39:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXfsyYGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:39:58 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e16270-579b-425d-862d-e397642f35a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e34cb3-ddef-4f76-a930-eae1d19a860f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a (non-flash)
Aug 09 01:39:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a (non-flash)
Aug 09 01:39:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0232d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cab1359-9610-4f46-842b-870eccab8ad9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[da113297-3507-4ed4-91cf-580b0ff5da17]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa1da6c-9d0b-4c76-91e5-3764d0a8bc10]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efaae1-fa47-4267-845c-7ea6690b00f6]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59085e7f-7cf5-4a24-b77f-50e83e257ada]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[babab754-b213-4d37-b21e-3b6e4518c83d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260]
Aug 09 01:39:58 user nova-compute[72780]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a, portal: 172.16.0.220,3260] successful.
Aug 09 01:39:58 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2f1340-dd30-4b34-96f1-78ec3be39c2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97fe0e2-e5b4-44f8-abbc-f5a707c60046]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== disconnect_volume: return (264ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:39:58 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:39:59 user nova-compute[72780]: DEBUG nova.objects.instance [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:39:59 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-eaee2cd4-dc4d-4706-9871-717c95a9523d tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:40:01 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:01 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:40:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:03 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:40:03 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:40:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.998397827148438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:40:03 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:40:04 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:40:04 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:40:04 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:40:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:40:05 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:40:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:40:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:40:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:40:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:40:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:40:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:40:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:40:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:40:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:40:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:40:47 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:40:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:40:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:40:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:40:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:40:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:40:52 user nova-compute[72780]: INFO nova.compute.manager [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attaching volume a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 to /dev/vdb
Aug 09 01:40:52 user nova-compute[72780]: DEBUG os_brick.utils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ffd11e-e886-401d-8c21-2aed696062d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e3e0e1-23a0-488d-bae0-91a7607573c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d66270-d5c8-4ca8-93f7-069f2e47870f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3ef4f-dcec-452a-9384-15e7dd837839]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:40:52 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:40:52 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fb6be5-c2b4-440c-aa30-5624dcd563f1]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG os_brick.utils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:40:52 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating existing volume attachment record: 90eafed2-99d0-4df3-9b21-158d9c04f977 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:40:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:40:57 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBTRzSqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:40:59 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:40:59 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:40:59 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dc7f8b-f7f9-4430-aefa-b2a7c9224c6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:40:59 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b57313-b0a5-490d-8657-09a07b0de62f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235] added
Aug 09 01:40:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f070a7f9-7c62-4d17-b333-b882bafe64bb]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6427d33e-fbb5-4509-80b2-1d45726cac37]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBTRzSqC {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBTRzSqC" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ba88d2-b616-4584-97ad-2c5247af2585]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tBTRzSqC'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d2f1f-3bd6-49f7-9ca1-531cd3314a65]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebda6a2-b71a-45cf-830e-2b3dc77ae337]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:40:59 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:40:59 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:40:59 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:40:59 user nova-compute[72780]: 
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4143799f-0fdc-4067-b768-86e4434235b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260]
Aug 09 01:40:59 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260] successful.
Aug 09 01:40:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df807d8b-780d-4102-9b52-4884758ba34d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00c3c4a-8bd3-44b4-9915-659edf4bcf6d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 (non-flash)
Aug 09 01:40:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 (non-flash)
Aug 09 01:40:59 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[df436262-193f-4ef1-9407-1b57a2c2216c]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:40:59 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBTRzSqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:41:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:41:00 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23365316162303632', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:41:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365316162303632', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:41:00 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:41:00 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:41:00 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:41:00 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:41:00 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:41:00 user nova-compute[72780]:   <serial>a3d1a4b8-9c91-4423-9c3a-4f1b894ad235</serial>
Aug 09 01:41:00 user nova-compute[72780]: </disk>
Aug 09 01:41:00 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:41:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:41:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:41:01 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No VIF found with MAC fa:16:3e:ec:8b:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:41:01 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7d528e2a-e623-4d2b-bd1c-fc037e663847 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.495s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:41:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:41:03 user nova-compute[72780]: INFO nova.compute.manager [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Detaching volume a3d1a4b8-9c91-4423-9c3a-4f1b894ad235
Aug 09 01:41:03 user nova-compute[72780]: INFO nova.virt.block_device [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attempting to driver detach volume a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 from mountpoint /dev/vdb
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Attempting to detach device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:41:03 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:41:03 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:41:03 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:41:03 user nova-compute[72780]:   <serial>a3d1a4b8-9c91-4423-9c3a-4f1b894ad235</serial>
Aug 09 01:41:03 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:41:03 user nova-compute[72780]: </disk>
Aug 09 01:41:03 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:41:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config.
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:41:03 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:41:03 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:41:03 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:41:03 user nova-compute[72780]:   <serial>a3d1a4b8-9c91-4423-9c3a-4f1b894ad235</serial>
Aug 09 01:41:03 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:41:03 user nova-compute[72780]: </disk>
Aug 09 01:41:03 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691545263.8809235, 5cb45fc5-ca72-442e-8e40-286e49680977 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:41:03 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config.
Aug 09 01:41:03 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBTRzSqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:41:03 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e6d60c-5812-48fb-aa62-7cc46361ded4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ae9e6-15d9-42c8-95ce-e58c4ab7321e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 (non-flash)
Aug 09 01:41:03 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 (non-flash)
Aug 09 01:41:03 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac0232680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[716e87aa-ca71-4de2-a2f1-9eeba1308547]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b4b7f-56b5-473c-a9fb-86f1ca1c0773]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:41:03 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cd658a-22a4-490b-b236-4c72cfd6ac0f]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3189f-859a-4cee-a143-20249086af8f]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70c96a-6ce8-4931-bfc6-5851d2565265]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b68106-3f6b-4b80-8363-f7ee9348a1cf]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260]
Aug 09 01:41:04 user nova-compute[72780]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235, portal: 172.16.0.220,3260] successful.
Aug 09 01:41:04 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3d1a4b8-9c91-4423-9c3a-4f1b894ad235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2bf26-95c4-4f43-9ad1-8c82e80d8f8a]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== disconnect_volume: return (269ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG nova.objects.instance [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:41:04 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-63af0ee2-0529-4084-ad23-8e287337bc3c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.529s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:05 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:41:05 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=24.997421264648438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:41:05 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:41:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:41:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:41:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:41:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:44 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:41:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:41:49 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:41:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:41:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:41:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:41:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:41:57 user nova-compute[72780]: INFO nova.compute.manager [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attaching volume df6df46d-c8e3-47ee-a41a-be35b6146438 to /dev/vdb
Aug 09 01:41:57 user nova-compute[72780]: DEBUG os_brick.utils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6fc4d-e03e-41d0-9913-c2e97be3e87c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d079f6e64e57\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f6fda-e2a3-413d-ac63-d6786b3870f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20df0cf-a809-49d2-8524-f9ac046ebbd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7baa96c-9776-4b6f-879d-618bcc2ae28d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Running cmd (subprocess): nvme version {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] 'nvme version' failed. Not Retrying. {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] nvme not present on system {{(pid=72780) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 01:41:57 user nova-compute[72780]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 01:41:57 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b56f031-22cd-468a-aa3a-68a098068518]: (4, '') {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72780) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] LIGHTOS: no hostnqn found. {{(pid=72780) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG os_brick.utils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d079f6e64e57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:41:57 user nova-compute[72780]: DEBUG nova.virt.block_device [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating existing volume attachment record: 7c598354-ad77-4c9c-ade6-7e0c91c6a8d8 {{(pid=72780) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 01:41:58 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:41:59 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:04 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:04 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Calling os-brick to attach iSCSI Volume {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKkUgAZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:42:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:42:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:42:05 user nova-compute[72780]: INFO os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff34ca-c50c-463f-806c-6f07881e57f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 01:42:05 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --interface default --op new {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e53687-9e6d-4610-a291-7834f5540d9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438] added\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438] added
Aug 09 01:42:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc98bf03-7efb-49a7-aae5-91266f45856d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a25be-9f94-4736-a21a-92d5c011e681]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKkUgAZL {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKkUgAZL" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5ef05-3560-4df5-aee7-fe340d837046]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MKkUgAZL'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[71382cf7-3d97-421d-af8e-46f5442beffd]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[477267d2-55e1-4c29-aea2-dad5275145d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:42:05 user nova-compute[72780]:  {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 01:42:05 user nova-compute[72780]:  {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:42:05 user nova-compute[72780]: WARNING os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 01:42:05 user nova-compute[72780]: 
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --login {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee55300-8661-4c2e-98c5-dd09a836c0f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260]
Aug 09 01:42:05 user nova-compute[72780]: Login to [iface: default, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260] successful.
Aug 09 01:42:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45d71f-b063-4478-b251-2a5b05930387]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae242d5-b9da-4e20-9166-113110295849]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 (non-flash)
Aug 09 01:42:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 (non-flash)
Aug 09 01:42:05 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to 172.16.0.220:3260 {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72780) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72780) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[23442930-cc8d-4ebc-b794-ae7e2050931e]: (4, ('- - 0', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:05 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72780) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKkUgAZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72780) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23130353462626238', 'path': '/dev/sdb'} {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353462626238', 'path': '/dev/sdb'} {{(pid=72780) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 01:42:06 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:42:06 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=24.996623992919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.objects.instance [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 01:42:06 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:42:06 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:42:06 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:42:06 user nova-compute[72780]:   <serial>df6df46d-c8e3-47ee-a41a-be35b6146438</serial>
Aug 09 01:42:06 user nova-compute[72780]: </disk>
Aug 09 01:42:06 user nova-compute[72780]:  {{(pid=72780) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:42:06 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vda, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72780) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] No VIF found with MAC fa:16:3e:ec:8b:82, not building metadata {{(pid=72780) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 01:42:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-b9b317fd-b6dc-4678-bdfc-dbd16e7a84bd tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.675s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:42:10 user nova-compute[72780]: INFO nova.compute.manager [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Detaching volume df6df46d-c8e3-47ee-a41a-be35b6146438
Aug 09 01:42:10 user nova-compute[72780]: INFO nova.virt.block_device [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Attempting to driver detach volume df6df46d-c8e3-47ee-a41a-be35b6146438 from mountpoint /dev/vdb
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Attempting to detach device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config. {{(pid=72780) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:42:10 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:42:10 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:42:10 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:42:10 user nova-compute[72780]:   <serial>df6df46d-c8e3-47ee-a41a-be35b6146438</serial>
Aug 09 01:42:10 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:42:10 user nova-compute[72780]: </disk>
Aug 09 01:42:10 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:42:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the persistent domain config.
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config. {{(pid=72780) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.guest [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 01:42:10 user nova-compute[72780]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 01:42:10 user nova-compute[72780]:   <source dev="/dev/sdb"/>
Aug 09 01:42:10 user nova-compute[72780]:   <target dev="vdb" bus="virtio"/>
Aug 09 01:42:10 user nova-compute[72780]:   <serial>df6df46d-c8e3-47ee-a41a-be35b6146438</serial>
Aug 09 01:42:10 user nova-compute[72780]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 01:42:10 user nova-compute[72780]: </disk>
Aug 09 01:42:10 user nova-compute[72780]:  {{(pid=72780) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-6b943b76-9115-48a1-a56b-daa0571d3024 None None] Received event <DeviceRemovedEvent: 1691545330.6390595, 5cb45fc5-ca72-442e-8e40-286e49680977 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72780) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.driver [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 01:42:10 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully detached device vdb from instance 5cb45fc5-ca72-442e-8e40-286e49680977 from the live domain config.
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] calling os-brick to detach iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0ac05901c0>, {'target_iqns': ['iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKkUgAZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 01:42:10 user nova-compute[72780]: WARNING os_brick.initiator.connectors.base [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438', 0)] {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b1536-8f71-4c90-9ac4-bdcc26824817]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae04912c-6c14-49a7-9e56-10f212d35344]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 (non-flash)\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 (non-flash)
Aug 09 01:42:10 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 (non-flash)
Aug 09 01:42:10 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ac01ee710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438'): ({'sdb'}, set())}) {{(pid=72780) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Removing single pathed devices sdb {{(pid=72780) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39ff58b-7a25-4d39-aaf4-ca65bed1986e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[234cadc3-98a4-464a-a509-49797abf54de]: (4, ('ok\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Flushing IO for device /dev/sdb {{(pid=72780) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744e10e-6cc9-4419-ba69-ad6e268d3030]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72780) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc32db-e63f-4981-96ef-0bc35e1ad18e]: (4, ('1', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.linuxscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] SCSI volumes sdb have been removed. {{(pid=72780) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438')] {{(pid=72780) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a135f7e-8116-498c-bd3e-17ec4a6d2a1b]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --logout {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a7db5-a781-484a-9675-f7d01a6f7cb2]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260]
Aug 09 01:42:10 user nova-compute[72780]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438, portal: 172.16.0.220,3260] successful.
Aug 09 01:42:10 user nova-compute[72780]:  stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op delete {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df6df46d-c8e3-47ee-a41a-be35b6146438 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83773) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG oslo.privsep.daemon [-] privsep: reply[99119739-5b11-4cbd-83bf-0ffb31216a6d]: (4, ('', '')) {{(pid=83773) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72780) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.base [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] <== disconnect_volume: return (282ms) None {{(pid=72780) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 01:42:10 user nova-compute[72780]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Disconnected iSCSI Volume {{(pid=72780) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG nova.objects.instance [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'flavor' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-7ceb4a6c-c03c-4e3a-a911-2d9896a1f60c tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:19 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:42:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:36 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:42:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:41 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:46 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquired lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Forcefully refreshing network info cache for instance {{(pid=72780) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG nova.objects.instance [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lazy-loading 'info_cache' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG nova.network.neutron [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [{"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Releasing lock "refresh_cache-5cb45fc5-ca72-442e-8e40-286e49680977" {{(pid=72780) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updated the network info_cache for instance {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:42:51 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:42:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:56 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:42:57 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:42:57 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72780) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 01:42:59 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:00 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:01 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:43:06 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.processutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 01:43:07 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:43:07 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:43:07 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=24.995750427246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:07 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Instance 5cb45fc5-ca72-442e-8e40-286e49680977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72780) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:43:08 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:11 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:16 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:17 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:21 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:43:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:43:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:43:26 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:43:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:43:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:43:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:34 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:34 user nova-compute[72780]: INFO nova.compute.manager [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Terminating instance
Aug 09 01:43:34 user nova-compute[72780]: DEBUG nova.compute.manager [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Start destroying the instance on the hypervisor. {{(pid=72780) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-7cc07dfb-803b-477d-b708-902bb06f6ce6 req-e5a57571-bd33-498a-946c-535b815d8a77 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-vif-unplugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7cc07dfb-803b-477d-b708-902bb06f6ce6 req-e5a57571-bd33-498a-946c-535b815d8a77 service nova] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7cc07dfb-803b-477d-b708-902bb06f6ce6 req-e5a57571-bd33-498a-946c-535b815d8a77 service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-7cc07dfb-803b-477d-b708-902bb06f6ce6 req-e5a57571-bd33-498a-946c-535b815d8a77 service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-7cc07dfb-803b-477d-b708-902bb06f6ce6 req-e5a57571-bd33-498a-946c-535b815d8a77 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] No waiting events found dispatching network-vif-unplugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.compute.manager [req-7cc07dfb-803b-477d-b708-902bb06f6ce6 req-e5a57571-bd33-498a-946c-535b815d8a77 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-vif-unplugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 for instance with task_state deleting. {{(pid=72780) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Instance destroyed successfully.
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.objects.instance [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lazy-loading 'resources' on Instance uuid 5cb45fc5-ca72-442e-8e40-286e49680977 {{(pid=72780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.virt.libvirt.vif [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T01:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1061233848',display_name='tempest-SnapshotDataIntegrityTests-server-1061233848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1061233848',id=52,image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3U/08nfyGumIvvb323PVITNL0sWVHUqqT2zciG8DCARaaRRDBqVWJtv7LfuEGMzToGnYzLSMJ1fZQXdUx7c+ioco7H3VuWQfK4/3NtYPA1WHDc/Cxvau14TDYK5kIVNA==',key_name='tempest-keypair-1323640319',keypairs=<?>,launch_index=0,launched_at=2023-08-09T01:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a9b52dce7ac465885f05713644683ae',ramdisk_id='',reservation_id='r-e57z0vs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f43f2d4e-45ef-42ce-9cde-789adcfd9b22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-549058555',owner_user_name='tempest-SnapshotDataIntegrityTests-549058555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T01:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c344777e6f5c4a65970668707bd2a1a5',uuid=5cb45fc5-ca72-442e-8e40-286e49680977,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Converting VIF {"id": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "address": "fa:16:3e:ec:8b:82", "network": {"id": "931015f2-8cbb-4c4d-9727-9876f4bed845", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1616784568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a9b52dce7ac465885f05713644683ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229f28d9-9b", "ovs_interfaceid": "229f28d9-9bf5-4668-b0d9-ebac622e05c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.network.os_vif_util [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b') {{(pid=72780) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG os_vif [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b') {{(pid=72780) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap229f28d9-9b, bridge=br-int, if_exists=True) {{(pid=72780) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:35 user nova-compute[72780]: INFO os_vif [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:8b:82,bridge_name='br-int',has_traffic_filtering=True,id=229f28d9-9bf5-4668-b0d9-ebac622e05c8,network=Network(931015f2-8cbb-4c4d-9727-9876f4bed845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229f28d9-9b')
Aug 09 01:43:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Deleting instance files /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977_del
Aug 09 01:43:35 user nova-compute[72780]: INFO nova.virt.libvirt.driver [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Deletion of /opt/stack/data/nova/instances/5cb45fc5-ca72-442e-8e40-286e49680977_del complete
Aug 09 01:43:35 user nova-compute[72780]: INFO nova.compute.manager [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 01:43:35 user nova-compute[72780]: DEBUG oslo.service.loopingcall [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72780) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.compute.manager [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Deallocating network for instance {{(pid=72780) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 01:43:35 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] deallocate_for_instance() {{(pid=72780) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 01:43:36 user nova-compute[72780]: DEBUG nova.network.neutron [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Updating instance_info_cache with network_info: [] {{(pid=72780) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 01:43:36 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Took 0.87 seconds to deallocate network for instance.
Aug 09 01:43:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:36 user nova-compute[72780]: DEBUG nova.compute.manager [req-f0b5d07a-40ad-4990-b0a2-4ad6bcb287b5 req-94172d06-bad0-46a9-8a9a-9d243cb9b5b5 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-vif-deleted-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:43:36 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:43:36 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:43:36 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:37 user nova-compute[72780]: INFO nova.scheduler.client.report [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Deleted allocations for instance 5cb45fc5-ca72-442e-8e40-286e49680977
Aug 09 01:43:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-f6ea5d45-762e-4061-ab81-dc0f53a26988 tempest-SnapshotDataIntegrityTests-549058555 tempest-SnapshotDataIntegrityTests-549058555-project-member] Lock "5cb45fc5-ca72-442e-8e40-286e49680977" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-c607bea2-26aa-4305-b2d6-06c4019e6d89 req-0fddf80a-2d0d-4c54-ba95-de571d0e60c5 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received event network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 01:43:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c607bea2-26aa-4305-b2d6-06c4019e6d89 req-0fddf80a-2d0d-4c54-ba95-de571d0e60c5 service nova] Acquiring lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:43:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c607bea2-26aa-4305-b2d6-06c4019e6d89 req-0fddf80a-2d0d-4c54-ba95-de571d0e60c5 service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:43:37 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [req-c607bea2-26aa-4305-b2d6-06c4019e6d89 req-0fddf80a-2d0d-4c54-ba95-de571d0e60c5 service nova] Lock "5cb45fc5-ca72-442e-8e40-286e49680977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:43:37 user nova-compute[72780]: DEBUG nova.compute.manager [req-c607bea2-26aa-4305-b2d6-06c4019e6d89 req-0fddf80a-2d0d-4c54-ba95-de571d0e60c5 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] No waiting events found dispatching network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 {{(pid=72780) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 01:43:37 user nova-compute[72780]: WARNING nova.compute.manager [req-c607bea2-26aa-4305-b2d6-06c4019e6d89 req-0fddf80a-2d0d-4c54-ba95-de571d0e60c5 service nova] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Received unexpected event network-vif-plugged-229f28d9-9bf5-4668-b0d9-ebac622e05c8 for instance with vm_state deleted and task_state None.
Aug 09 01:43:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:42 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Cleaning up deleted instances {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 01:43:42 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] There are 0 instances to clean {{(pid=72780) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 01:43:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:47 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:50 user nova-compute[72780]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691545415.7424834, 5cb45fc5-ca72-442e-8e40-286e49680977 => Stopped> {{(pid=72780) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 01:43:50 user nova-compute[72780]: INFO nova.compute.manager [-] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] VM Stopped (Lifecycle Event)
Aug 09 01:43:50 user nova-compute[72780]: DEBUG nova.compute.manager [None req-955604af-666c-4359-8046-5c76842c9bb5 None None] [instance: 5cb45fc5-ca72-442e-8e40-286e49680977] Checking state {{(pid=72780) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 01:43:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:43:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:43:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:43:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 01:43:54 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:43:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:43:59 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:00 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:02 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:05 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:08 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:08 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72780) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Auditing locally available compute resources for user (node: user) {{(pid=72780) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 01:44:09 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:44:09 user nova-compute[72780]: WARNING nova.virt.libvirt.driver [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=25.022953033447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72780) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72780) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing inventories for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating ProviderTree inventory for provider b9abbddb-d385-4222-ae5f-4e6421336ccf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Updating inventory in ProviderTree for provider b9abbddb-d385-4222-ae5f-4e6421336ccf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing aggregate associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, aggregates: None {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Refreshing trait associations for resource provider b9abbddb-d385-4222-ae5f-4e6421336ccf, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC {{(pid=72780) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.provider_tree [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed in ProviderTree for provider: b9abbddb-d385-4222-ae5f-4e6421336ccf {{(pid=72780) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.scheduler.client.report [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Inventory has not changed for provider b9abbddb-d385-4222-ae5f-4e6421336ccf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72780) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG nova.compute.resource_tracker [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Compute_service record updated for user:user {{(pid=72780) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 01:44:09 user nova-compute[72780]: DEBUG oslo_concurrency.lockutils [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=72780) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 01:44:10 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:15 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:44:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:44:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:44:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:44:20 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:23 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:25 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:29 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:30 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:31 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:32 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:35 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:40 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:45 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:49 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:44:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72780) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 01:44:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:44:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72780) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 01:44:50 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 01:44:53 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 01:44:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Starting heal instance info cache {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 01:44:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Rebuilding the list of instances to heal {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 01:44:53 user nova-compute[72780]: DEBUG nova.compute.manager [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Didn't find any instances for network info cache update. {{(pid=72780) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 01:44:55 user nova-compute[72780]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72780) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 01:44:56 user nova-compute[72780]: DEBUG oslo_service.periodic_task [None req-c420534f-7c44-420c-8f06-cbc1c5ee930a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72780) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}